Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
CUDA update broke my throughput
#13
Quote:Interesting, I hadn't tried that. I ended up in about the same place using SGLang.

My first guess would be this: Before rebuilding anything, I'd test one clean baseline with Qwen and compare from there. Not glamorous advice, but repeatable baselines save a lot of time.

If you post your exact settings, people here can probably narrow it down pretty fast.
Reply


Messages In This Thread
CUDA update broke my throughput - by edgecoast - 09-17-2026, 07:46 PM
Re: CUDA update broke my throughput - by edgecoast - 09-24-2026, 06:55 AM

Forum Jump:


Users browsing this thread: 1 Guest(s)