router in front of vLLM for Phi

Thread Rating:

0 Vote(s) - 0 Average
1
2
3
4
5

Linear Mode

router in front of vLLM for Phi

audioforge Offline

Offline

Member

Posts: 51
Threads: 6
Joined: Aug 2026
Reputation: 0

#9

10-17-2026, 01:09 AM

What exact setup are you running? Is this local-only or are you routing anything externally?

serving stack tinkerer

Find

Reply

« Next Oldest | Next Newest »

Messages In This Thread

router in front of vLLM for Phi - by cacheline - 10-16-2026, 03:04 AM

Re: router in front of vLLM for Phi - by rocmrunner40 - 10-16-2026, 11:14 AM

Re: router in front of vLLM for Phi - by signalcraft14 - 10-16-2026, 12:20 PM

Re: router in front of vLLM for Phi - by audioforge - 10-16-2026, 05:10 PM

Re: router in front of vLLM for Phi - by batchsize - 10-16-2026, 07:46 PM

Re: router in front of vLLM for Phi - by tensorfield88 - 10-16-2026, 09:50 PM

Re: router in front of vLLM for Phi - by deltapoint17 - 10-16-2026, 10:50 PM

Re: router in front of vLLM for Phi - by audioforge - 10-17-2026, 01:09 AM

Re: router in front of vLLM for Phi - by dockridge - 10-16-2026, 11:50 PM

Re: router in front of vLLM for Phi - by signalcraft14 - 10-17-2026, 01:31 AM

Re: router in front of vLLM for Phi - by thetashed24 - 10-18-2026, 02:15 AM

Re: router in front of vLLM for Phi - by llmarch83 - 10-18-2026, 08:09 PM

Re: router in front of vLLM for Phi - by cacheline - 10-19-2026, 02:19 AM

Re: router in front of vLLM for Phi - by promptspark58 - 10-19-2026, 03:12 AM

Re: router in front of vLLM for Phi - by signalcraft14 - 10-19-2026, 05:01 AM

View a Printable Version

Forum Jump:

Users browsing this thread: 1 Guest(s)