Inference › Inference Engines › vLLM / SGLang v
continuous batching wins and losses with Ollama

Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Threaded Mode
continuous batching wins and losses with Ollama
phasestream53 Offline
Junior Member
**
Posts: 43
Threads: 5
Joined: Sep 2026
Reputation: 0
#11
10-08-2026, 11:08 PM
that fixed it for me too.
Find
Reply
routeline23 Offline
Junior Member
**
Posts: 46
Threads: 7
Joined: Sep 2026
Reputation: 0
#12
10-08-2026, 11:54 PM
Ran a quick check on my box. The issue went away once I changed one setting and restarted the stack cleanly. I expected the model choice to matter more than it did.
Find
Reply


Forum Jump:


Users browsing this thread: 1 Guest(s)