09-17-2026, 11:51 PM
I'm trying to sanity-check my setup.
My current setup is Ollama with GB200, and I keep running into continuous batching.
If you've tested something similar, what did you keep and what did you stop bothering with?
This is mostly for local work rather than public serving.
My current setup is Ollama with GB200, and I keep running into continuous batching.
If you've tested something similar, what did you keep and what did you stop bothering with?
This is mostly for local work rather than public serving.
