PyTorch compile got faster? with vLLM

Thread Rating:

0 Vote(s) - 0 Average
1
2
3
4
5

Linear Mode

PyTorch compile got faster? with vLLM

sparrowgrid Offline

Junior Member

Posts: 20
Threads: 1
Joined: Sep 2026
Reputation: 0

09-09-2026, 08:15 PM

Tried to reproduce it just now. My result was mixed: first run looked bad, second run looked normal. The surprise was that memory pressure showed up before throughput collapsed.

still benchmarking everything

Find

« Next Oldest | Next Newest »

Messages In This Thread

PyTorch compile got faster? with vLLM - by dockworks23 - 09-08-2026, 05:31 AM

Re: PyTorch compile got faster? with vLLM - by batchwire - 09-08-2026, 01:43 PM

Re: PyTorch compile got faster? with vLLM - by sparrowgrid - 09-09-2026, 08:15 PM

Re: PyTorch compile got faster? with vLLM - by cachelab - 09-08-2026, 02:35 PM

Re: PyTorch compile got faster? with vLLM - by thetaember38 - 09-08-2026, 04:59 PM

Re: PyTorch compile got faster? with vLLM - by cozykite - 09-08-2026, 07:08 PM

Re: PyTorch compile got faster? with vLLM - by northgrid33 - 09-08-2026, 07:47 PM

Re: PyTorch compile got faster? with vLLM - by batchember - 09-10-2026, 01:05 AM

Re: PyTorch compile got faster? with vLLM - by promptfield - 09-10-2026, 01:45 AM

Re: PyTorch compile got faster? with vLLM - by audiopath66 - 09-10-2026, 03:43 PM

Re: PyTorch compile got faster? with vLLM - by torchdesk - 09-10-2026, 03:05 AM

Re: PyTorch compile got faster? with vLLM - by vramghost - 09-10-2026, 04:01 PM

Re: PyTorch compile got faster? with vLLM - by minthall - 09-10-2026, 04:48 PM

View a Printable Version

Forum Jump:

Users browsing this thread: 2 Guest(s)

Login
Username:
Password:	Lost Password?
	Remember me

Sign in with X.com