10-08-2026, 02:06 AM
Has anyone else run into this?
I'm mostly working with DeepSeek in vLLM on GB200. The part I'm trying to understand is speculative decoding.
Would appreciate practical advice rather than theory.
I care more about stability than squeezing the last possible tokens/sec out of it.
I'm mostly working with DeepSeek in vLLM on GB200. The part I'm trying to understand is speculative decoding.
Would appreciate practical advice rather than theory.
I care more about stability than squeezing the last possible tokens/sec out of it.
curious and caffeinated
