benchmarks that map to real use with vLLM

Thread Rating:

0 Vote(s) - 0 Average
1
2
3
4
5

Linear Mode

benchmarks that map to real use with vLLM

ggufwire22 Offline

Member

Posts: 93
Threads: 10
Joined: Oct 2026
Reputation: 0

#15

09-10-2026, 08:55 AM

Quote:Tried to reproduce it just now. On Threadripper box with PyTorch, I saw basically the same behavior. The main thing that moved was latency, not qualit

following this because I'm in the same boat.

Find

« Next Oldest | Next Newest »

Messages In This Thread

benchmarks that map to real use with vLLM - by sparrowcraft - 09-03-2026, 03:23 PM

Re: benchmarks that map to real use with vLLM - by stackarch - 09-03-2026, 04:13 PM

Re: benchmarks that map to real use with vLLM - by cudaline - 09-04-2026, 12:58 AM

Re: benchmarks that map to real use with vLLM - by oxiderunner - 09-05-2026, 01:36 PM

Re: benchmarks that map to real use with vLLM - by plainscope50 - 09-05-2026, 09:38 PM

Re: benchmarks that map to real use with vLLM - by thetaplane - 09-06-2026, 02:19 AM

Re: benchmarks that map to real use with vLLM - by orbitgarden - 09-06-2026, 01:28 PM

Re: benchmarks that map to real use with vLLM - by southtinker - 09-05-2026, 10:09 PM

Re: benchmarks that map to real use with vLLM - by ggufwire22 - 09-10-2026, 08:55 AM

Re: benchmarks that map to real use with vLLM - by marbletrack - 09-06-2026, 10:26 AM

Re: benchmarks that map to real use with vLLM - by byteyard - 09-06-2026, 12:41 PM

Re: benchmarks that map to real use with vLLM - by thetanest - 09-06-2026, 10:01 PM

Re: benchmarks that map to real use with vLLM - by batchsize - 09-09-2026, 10:10 PM

Re: benchmarks that map to real use with vLLM - by quantghost - 09-10-2026, 06:58 AM

Re: benchmarks that map to real use with vLLM - by northcraft90 - 09-10-2026, 07:42 AM

Re: benchmarks that map to real use with vLLM - by sanevault - 09-10-2026, 09:51 AM

View a Printable Version

Forum Jump:

Users browsing this thread: 1 Guest(s)

Login
Username:
Password:	Lost Password?
	Remember me

Sign in with X.com