09-07-2026, 10:22 PM
I figured I'd ask here before changing everything.
My current setup is Ollama with 5090, and I keep running into continuous batching.
If you've tested something similar, what did you keep and what did you stop bothering with?
My current setup is Ollama with 5090, and I keep running into continuous batching.
If you've tested something similar, what did you keep and what did you stop bothering with?