Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
why did throughput drop after update
#4
Quote:My first guess would be this: If you're on SGLang, I'd confirm the version first and then reduce variables until the behavior is obvious. Not glamorou

subscribed, curious where this lands.
measure twice, benchmark three times
Reply


Messages In This Thread
Re: why did throughput drop after update - by cacheline - 10-17-2026, 07:12 AM

Forum Jump:


Users browsing this thread: 1 Guest(s)