Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
CUDA update broke my throughput with Ollama
#6
Interesting, I hadn't tried that. The pattern around consumer GPUs has been pretty similar for me. The biggest change for me was simplifying the stack instead of adding one more optimization layer.
Reply


Messages In This Thread
Re: CUDA update broke my throughput with Ollama - by edgecoast - 09-24-2026, 03:13 AM

Forum Jump:


Users browsing this thread: 1 Guest(s)