CUDA update broke my throughput

[dockember]

Interesting, I hadn't tried that. That matches what I saw on mini PC.

[mintforge]

Interesting, I hadn't tried that. I ended up in about the same place using SGLang.

[edgecoast]

Interesting, I hadn't tried that. I ended up in about the same place using SGLang.

My first guess would be this: Before rebuilding anything, I'd test one clean baseline with Qwen and compare from there. Not glamorous advice, but repeatable baselines save a lot of time.

If you post your exact settings, people here can probably narrow it down pretty fast.

[audiopath66]

What worked for me was pretty simple. On dual 3090, the easiest win is often to back off the aggressive settings and see whether the problem survives. A lot of these threads end up being one bad config plus a pile of conclusions drawn from it.

[vramstream]

Thanks, that helps. The pattern around quant drift has been pretty similar for me.