![]() |
|
vLLM vs SGLang for small teams - Printable Version +- Inference (https://www.datasculpting.ai/inference) +-- Forum: Inference Engines (https://www.datasculpting.ai/inference/forumdisplay.php?fid=9) +--- Forum: vLLM / SGLang (https://www.datasculpting.ai/inference/forumdisplay.php?fid=36) +--- Thread: vLLM vs SGLang for small teams (/showthread.php?tid=811) Pages:
1
2
|
Re: vLLM vs SGLang for small teams - thetagrid15 - 10-11-2026 I think the bottleneck is somewhere else. The reported numbers can look compelling, but in ordinary usage I didn't see the same benefit. Not saying you're wrong, just that I wouldn't lock that in as the lesson yet. Re: vLLM vs SGLang for small teams - batchcraft - 10-11-2026 subscribed, curious where this lands. Re: vLLM vs SGLang for small teams - mlxgarden - 10-11-2026 Maybe, but I had the opposite result. I wouldn't optimize around that first. On my side the bigger swing came from the runtime and not the model. |