10-10-2026, 10:54 PM
I'm trying to sanity-check my setup.
I'm mostly working with DeepSeek in vLLM on B200. The part I'm trying to understand is MoE serving.
Would appreciate practical advice rather than theory.
My use case is pretty ordinary: local chat, some document work, and occasional batch jobs.
I'm mostly working with DeepSeek in vLLM on B200. The part I'm trying to understand is MoE serving.
Would appreciate practical advice rather than theory.
My use case is pretty ordinary: local chat, some document work, and occasional batch jobs.
still benchmarking everything