Inference › Inference Engines › vLLM / SGLang v
router in front of vLLM

Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Linear Mode
router in front of vLLM
routearch Offline
Member
***
Posts: 63
Threads: 5
Joined: Sep 2026
Reputation: 0
#3
10-18-2026, 08:02 PM
Thanks, that helps. I don't think your conclusion is far off. Worth rechecking your defaults though, because one bad assumption can make the rest of the thread look confusing.
Find
Reply


Messages In This Thread
router in front of vLLM - by thetaplane - 10-16-2026, 02:28 AM
Re: router in front of vLLM - by kernelghost - 10-16-2026, 07:09 AM
Re: router in front of vLLM - by routearch - 10-18-2026, 08:02 PM
Re: router in front of vLLM - by turbosupply83 - 10-18-2026, 08:33 PM
Re: router in front of vLLM - by cacheline - 10-18-2026, 08:57 PM
Re: router in front of vLLM - by ggufvault - 10-19-2026, 01:11 AM
Re: router in front of vLLM - by southspark - 10-19-2026, 01:11 AM
Re: router in front of vLLM - by audioforge - 10-19-2026, 01:42 AM
Re: router in front of vLLM - by cacheline - 10-19-2026, 02:31 AM
Re: router in front of vLLM - by amberrunner - 10-19-2026, 04:37 AM
Re: router in front of vLLM - by thetashed24 - 10-19-2026, 04:18 AM
Re: router in front of vLLM - by routearch - 10-19-2026, 05:42 AM
Re: router in front of vLLM - by ggufwire22 - 10-19-2026, 05:48 AM

Forum Jump:


Users browsing this thread: 1 Guest(s)