Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
vLLM vs SGLang for small teams
#1
Did a bit of testing and thought I'd post the result here.

Short version: SGLang behaved well for me, but only after I stopped ignoring NVFP4.

Nothing scientific here, just practical notes from a real setup.

I care more about stability than squeezing the last possible tokens/sec out of it.

If I had to summarize the lesson so far, it would be that clean setup and observability beat clever guesses.
trying not to rebuild again
Reply


Messages In This Thread
vLLM vs SGLang for small teams - by amberrunner - 09-24-2026, 04:50 PM
Re: vLLM vs SGLang for small teams - by cacheline - 09-25-2026, 06:17 PM
Re: vLLM vs SGLang for small teams - by cudacrate - 09-26-2026, 06:31 PM
Re: vLLM vs SGLang for small teams - by edgequill - 09-30-2026, 01:17 AM
Re: vLLM vs SGLang for small teams - by torchkite - 10-03-2026, 05:12 PM
Re: vLLM vs SGLang for small teams - by batchpeak - 10-03-2026, 06:25 PM

Forum Jump:


Users browsing this thread: 1 Guest(s)