benchmarks that map to real use with vLLM

Thread Rating:

0 Vote(s) - 0 Average
1
2
3
4
5

Linear Mode

benchmarks that map to real use with vLLM

stackarch Offline

Junior Member

Posts: 34
Threads: 3
Joined: Aug 2026
Reputation: 0

09-03-2026, 04:13 PM

Quote:Did a bit of testing and thought I'd post the result here.

Tried to reproduce it just now. The issue went away once I changed one setting and restarted the stack cleanly. I expected the model choice to matter more than it did.

Find

« Next Oldest | Next Newest »

Messages In This Thread

benchmarks that map to real use with vLLM - by sparrowcraft - 09-03-2026, 03:23 PM

Re: benchmarks that map to real use with vLLM - by stackarch - 09-03-2026, 04:13 PM

Re: benchmarks that map to real use with vLLM - by cudaline - 09-04-2026, 12:58 AM

Re: benchmarks that map to real use with vLLM - by oxiderunner - 09-05-2026, 01:36 PM

Re: benchmarks that map to real use with vLLM - by plainscope50 - 09-05-2026, 09:38 PM

Re: benchmarks that map to real use with vLLM - by thetaplane - 09-06-2026, 02:19 AM

Re: benchmarks that map to real use with vLLM - by orbitgarden - 09-06-2026, 01:28 PM

Re: benchmarks that map to real use with vLLM - by southtinker - 09-05-2026, 10:09 PM

Re: benchmarks that map to real use with vLLM - by ggufwire22 - 09-10-2026, 08:55 AM

Re: benchmarks that map to real use with vLLM - by marbletrack - 09-06-2026, 10:26 AM

Re: benchmarks that map to real use with vLLM - by byteyard - 09-06-2026, 12:41 PM

Re: benchmarks that map to real use with vLLM - by thetanest - 09-06-2026, 10:01 PM

Re: benchmarks that map to real use with vLLM - by batchsize - 09-09-2026, 10:10 PM

Re: benchmarks that map to real use with vLLM - by quantghost - 09-10-2026, 06:58 AM

Re: benchmarks that map to real use with vLLM - by northcraft90 - 09-10-2026, 07:42 AM

Re: benchmarks that map to real use with vLLM - by sanevault - 09-10-2026, 09:51 AM

View a Printable Version

Forum Jump:

Users browsing this thread: 1 Guest(s)

Login
Username:
Password:	Lost Password?
	Remember me

Sign in with X.com