10-12-2026, 04:01 AM
I figured I'd ask here before changing everything.
I'm mostly working with DeepSeek in SGLang on Threadripper box. The part I'm trying to understand is prefill/decode split.
Would appreciate practical advice rather than theory.
I'm mostly working with DeepSeek in SGLang on Threadripper box. The part I'm trying to understand is prefill/decode split.
Would appreciate practical advice rather than theory.
post logs or it didn't happen