+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Drivers / Frameworks / Toolkits (https://www.datasculpting.ai/inference/forumdisplay.php?fid=8)
+--- Forum: NVIDIA / CUDA (https://www.datasculpting.ai/inference/forumdisplay.php?fid=31)
+--- Thread: CUDA update broke my throughput (/showthread.php?tid=184)
Pages:
1
2
Re: CUDA update broke my throughput - phaseport36 - 09-13-2026
Appreciate the detail. I ended up in about the same place using llama.cpp. Worth rechecking your defaults though, because one bad assumption can make the rest of the thread look confusing.
Re: CUDA update broke my throughput - kernelmike - 09-14-2026
What exact setup are you running? Are you testing this on 5090 or something else?
Re: CUDA update broke my throughput - dockember - 09-14-2026
that fixed it for me too.