+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Inference Engines (https://www.datasculpting.ai/inference/forumdisplay.php?fid=9)
+--- Forum: vLLM / SGLang (https://www.datasculpting.ai/inference/forumdisplay.php?fid=36)
+--- Thread: vLLM vs SGLang for small teams on 5090 (/showthread.php?tid=593)
vLLM vs SGLang for small teams on 5090 - oxidemixer - 09-29-2026
This keeps coming up in conversation so I figured I'd start a thread.
One thing I keep noticing is that people underestimate workstation thermals until they actually try to run this stuff for more than one afternoon.
Maybe obvious to some of you, but it clicked for me this week.
Re: vLLM vs SGLang for small teams on 5090 - thetashed24 - 09-29-2026
Thanks, that helps. That matches what I saw on 4090. The biggest change for me was simplifying the stack instead of adding one more optimization layer.
Re: vLLM vs SGLang for small teams on 5090 - batchsize - 10-02-2026
Quote:Thanks, that helps. That matches what I saw on 4090. The biggest change for me was simplifying the stack instead of adding one more optimization layer
same here on my side.
Re: vLLM vs SGLang for small teams on 5090 - amberrunner - 10-02-2026
Good point. The pattern around router policy has been pretty similar for me. Worth rechecking your defaults though, because one bad assumption can make the rest of the thread look confusing.
Re: vLLM vs SGLang for small teams on 5090 - rocmrunner40 - 10-04-2026
A couple questions before I guess too hard. Are you testing this on mini PC or something else?
Re: vLLM vs SGLang for small teams on 5090 - oxidemixer - 10-04-2026
Tried to reproduce it just now. The issue went away once I changed one setting and restarted the stack cleanly. The main thing that moved was latency, not quality.
Re: vLLM vs SGLang for small teams on 5090 - batchcraft - 10-05-2026
Appreciate the detail. The pattern around batch size has been pretty similar for me. The biggest change for me was simplifying the stack instead of adding one more optimization layer.