+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Inference Engines (https://www.datasculpting.ai/inference/forumdisplay.php?fid=9)
+--- Forum: vLLM / SGLang (https://www.datasculpting.ai/inference/forumdisplay.php?fid=36)
+--- Thread: continuous batching wins and losses with Ollama (/showthread.php?tid=652)
Pages:
1
2
Re: continuous batching wins and losses with Ollama - phasestream53 - 10-08-2026
that fixed it for me too.
Re: continuous batching wins and losses with Ollama - routeline23 - 10-08-2026
Ran a quick check on my box. The issue went away once I changed one setting and restarted the stack cleanly. I expected the model choice to matter more than it did.