CUDA update broke my throughput with Ollama

Thread Rating:

0 Vote(s) - 0 Average
1
2
3
4
5

Linear Mode

CUDA update broke my throughput with Ollama

sparrowkite53 Offline

Offline

Junior Member

Posts: 38
Threads: 5
Joined: Sep 2026
Reputation: 0

#13

09-30-2026, 01:58 AM

I tested this tonight. I couldn't reproduce the slowdown until I pushed context much higher.

Find

Reply

« Next Oldest | Next Newest »

Messages In This Thread

CUDA update broke my throughput with Ollama - by kernelmike - 09-23-2026, 12:56 PM

Re: CUDA update broke my throughput with Ollama - by rasterhall - 09-23-2026, 03:07 PM

Re: CUDA update broke my throughput with Ollama - by northgarden37 - 09-23-2026, 11:36 PM

Re: CUDA update broke my throughput with Ollama - by dockember - 09-24-2026, 12:24 AM

Re: CUDA update broke my throughput with Ollama - by promptspark58 - 09-27-2026, 08:50 PM

Re: CUDA update broke my throughput with Ollama - by sparrowkite53 - 09-24-2026, 02:27 AM

Re: CUDA update broke my throughput with Ollama - by edgecoast - 09-24-2026, 03:13 AM

Re: CUDA update broke my throughput with Ollama - by thetapath - 09-24-2026, 11:43 AM

Re: CUDA update broke my throughput with Ollama - by kernelmike - 09-24-2026, 11:55 AM

Re: CUDA update broke my throughput with Ollama - by audiopath66 - 09-24-2026, 08:07 PM

Re: CUDA update broke my throughput with Ollama - by edgecoast - 09-28-2026, 09:31 AM

Re: CUDA update broke my throughput with Ollama - by audiopath66 - 09-28-2026, 01:42 PM

Re: CUDA update broke my throughput with Ollama - by sparrowkite53 - 09-30-2026, 01:58 AM

Re: CUDA update broke my throughput with Ollama - by stackarch - 09-30-2026, 02:05 AM

View a Printable Version

Forum Jump:

Users browsing this thread: 1 Guest(s)