vLLM vs SGLang for small teams

[southpatch]

Did a small comparison this afternoon. The issue went away once I changed one setting and restarted the stack cleanly. I expected the model choice to matter more than it did. At this point the real bottleneck is my patience.

[promptpoint]

Maybe, but I had the opposite result. I get why that seems right, but on 5090 the bottleneck felt elsewhere. Worth testing the simpler explanation before adopting the more interesting one.

[thetaplane]

Maybe, but I had the opposite result. I get why that seems right, but on A6000 the bottleneck felt elsewhere. Not saying you're wrong, just that I wouldn't lock that in as the lesson yet.

[promptpoint]

Thanks, that helps. The pattern around MoE serving has been pretty similar for me. I got better results once I stopped chasing one metric and just looked at whether the workflow felt usable.