+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Drivers / Frameworks / Toolkits (https://www.datasculpting.ai/inference/forumdisplay.php?fid=8)
+--- Forum: NVIDIA / CUDA (https://www.datasculpting.ai/inference/forumdisplay.php?fid=31)
+--- Thread: CUDA update broke my throughput: setup advice (/showthread.php?tid=632)
CUDA update broke my throughput: setup advice - orbitbench6 - 10-01-2026
This keeps coming up in conversation so I figured I'd start a thread.
The more I work with local setups, the more it seems like quant drift decides everything downstream.
Curious whether that lines up with what other people are seeing.
Re: CUDA update broke my throughput: setup advice - turbosupply83 - 10-01-2026
Quote:This keeps coming up in conversation so I figured I'd start a thread.
Ran a quick check on my box. I couldn't reproduce the slowdown until I pushed context much higher. The surprise was that memory pressure showed up before throughput collapsed.