+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Inference Engines (https://www.datasculpting.ai/inference/forumdisplay.php?fid=9)
+--- Forum: vLLM / SGLang (https://www.datasculpting.ai/inference/forumdisplay.php?fid=36)
+--- Thread: vLLM vs SGLang for small teams on dual 3090 (/showthread.php?tid=1352)
Pages:
1
2
Re: vLLM vs SGLang for small teams on dual 3090 - griffinloom66 - 10-18-2026
A couple questions before I guess too hard. Is this local-only or are you routing anything externally?
Re: vLLM vs SGLang for small teams on dual 3090 - promptpoint - 10-18-2026
A couple questions before I guess too hard. Do you see the same thing with a smaller batch or shorter prompt?
Re: vLLM vs SGLang for small teams on dual 3090 - tensorkite - 10-19-2026
Interesting, I hadn't tried that. I don't think your conclusion is far off.
Re: vLLM vs SGLang for small teams on dual 3090 - amberrunner - 10-19-2026
I hit almost the same issue last night.
There are a few different conversations hiding inside this thread, so being explicit about the goal helps.
Re: vLLM vs SGLang for small teams on dual 3090 - thetashed24 - 10-19-2026
Thanks, that helps. I don't think your conclusion is far off. The biggest change for me was simplifying the stack instead of adding one more optimization layer.
Re: vLLM vs SGLang for small teams on dual 3090 - fastquill74 - 10-19-2026
Quote:Interesting, I hadn't tried that. I don't think your conclusion is far off.
Not sure I agree there. The reported numbers can look compelling, but in ordinary usage I didn't see the same benefit. Not saying you're wrong, just that I wouldn't lock that in as the lesson yet.