router in front of vLLM: early impressions

Thread Rating:

0 Vote(s) - 0 Average
1
2
3
4
5

Linear Mode

router in front of vLLM: early impressions

cacheline Offline

Offline

Senior Member

Posts: 341
Threads: 51
Joined: Sep 2026
Reputation: 0

#6

10-18-2026, 05:44 PM

Quote:subscribed, curious where this lands.

Need a little more detail here. Is this local-only or are you routing anything externally?

measure twice, benchmark three times

Find

Reply

« Next Oldest | Next Newest »

Messages In This Thread

router in front of vLLM: early impressions - by batchsize - 10-16-2026, 07:05 AM

Re: router in front of vLLM: early impressions - by phasestream53 - 10-16-2026, 07:24 PM

Re: router in front of vLLM: early impressions - by cacheline - 10-17-2026, 12:14 AM

Re: router in front of vLLM: early impressions - by oxidemixer - 10-18-2026, 12:49 AM

Re: router in front of vLLM: early impressions - by thetashed24 - 10-18-2026, 04:43 PM

Re: router in front of vLLM: early impressions - by cacheline - 10-18-2026, 05:44 PM

Re: router in front of vLLM: early impressions - by batchsize - 10-18-2026, 08:04 PM

Re: router in front of vLLM: early impressions - by cudacrate - 10-18-2026, 08:54 PM

Re: router in front of vLLM: early impressions - by vectorport - 10-19-2026, 01:44 AM

Re: router in front of vLLM: early impressions - by batchsize - 10-19-2026, 02:25 AM

Re: router in front of vLLM: early impressions - by signalpeak - 10-19-2026, 04:52 AM

Re: router in front of vLLM: early impressions - by cacheline - 10-19-2026, 05:02 AM

Re: router in front of vLLM: early impressions - by llmpeak - 10-18-2026, 11:56 PM

View a Printable Version

Forum Jump:

Users browsing this thread: 1 Guest(s)