Inference › Inference Engines › vLLM / SGLang v
why did throughput drop after update

Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Linear Mode
why did throughput drop after update
batchsize Offline
Member
***
Posts: 137
Threads: 16
Joined: Sep 2026
Reputation: 0
#8
10-18-2026, 07:46 PM
that fixed it for me too.

If you post your exact settings, people here can probably narrow it down pretty fast.
throughput matters, but tail latency matters too
Find
Reply


Messages In This Thread
Re: why did throughput drop after update - by batchsize - 10-18-2026, 07:46 PM

Forum Jump:


Users browsing this thread: 1 Guest(s)