09-16-2026, 11:41 PM
Tried to reproduce it just now. On dual 3090 with Ollama, I saw basically the same behavior. The surprise was that memory pressure showed up before throughput collapsed.
queue depth watcher
|
continuous batching wins and losses
|
|
« Next Oldest | Next Newest »
|
Users browsing this thread: 1 Guest(s)