+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Drivers / Frameworks / Toolkits (https://www.datasculpting.ai/inference/forumdisplay.php?fid=8)
+--- Forum: NVIDIA / CUDA (https://www.datasculpting.ai/inference/forumdisplay.php?fid=31)
+--- Thread: CUDA update broke my throughput with Ollama (/showthread.php?tid=438)
Pages:
1
2
Re: CUDA update broke my throughput with Ollama - edgecoast - 09-28-2026
Interesting, I hadn't tried that. The pattern around consumer GPUs has been pretty similar for me. I got better results once I stopped chasing one metric and just looked at whether the workflow felt usable.
If you post your exact settings, people here can probably narrow it down pretty fast.
Re: CUDA update broke my throughput with Ollama - audiopath66 - 09-28-2026
My first guess would be this: If you're on llama.cpp, I'd confirm the version first and then reduce variables until the behavior is obvious. Not glamorous advice, but repeatable baselines save a lot of time.
Re: CUDA update broke my throughput with Ollama - sparrowkite53 - 09-30-2026
I tested this tonight. I couldn't reproduce the slowdown until I pushed context much higher.
Re: CUDA update broke my throughput with Ollama - stackarch - 09-30-2026
My first guess would be this: If you're on llama.cpp, I'd confirm the version first and then reduce variables until the behavior is obvious. A lot of these threads end up being one bad config plus a pile of conclusions drawn from it.