Inference › Inference Engines › vLLM / SGLang v
router in front of vLLM for Phi

Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Linear Mode
router in front of vLLM for Phi
llmarch83 Offline
Junior Member
**
Posts: 20
Threads: 3
Joined: Sep 2026
Reputation: 0
#12
10-18-2026, 08:09 PM
Appreciate the detail. That matches what I saw on 5090. I got better results once I stopped chasing one metric and just looked at whether the workflow felt usable.

If you post your exact settings, people here can probably narrow it down pretty fast.
Find
Reply


Messages In This Thread
router in front of vLLM for Phi - by cacheline - 10-16-2026, 03:04 AM
Re: router in front of vLLM for Phi - by llmarch83 - 10-18-2026, 08:09 PM

Forum Jump:


Users browsing this thread: 1 Guest(s)