Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
vLLM vs SGLang for small teams
#1
Maybe I'm missing something obvious.

I'm trying to decide whether to keep the current stack or change course. Main question is how people here are handling tokens/sec.

If you've tested something similar, what did you keep and what did you stop bothering with?

I care more about stability than squeezing the last possible tokens/sec out of it.
Reply


Messages In This Thread
vLLM vs SGLang for small teams - by signalcraft14 - 09-21-2026, 07:25 PM
Re: vLLM vs SGLang for small teams - by vramport - 09-22-2026, 12:36 AM
Re: vLLM vs SGLang for small teams - by batchsize - 09-22-2026, 11:46 AM
Re: vLLM vs SGLang for small teams - by routearch - 09-23-2026, 03:06 PM

Forum Jump:


Users browsing this thread: 1 Guest(s)