|
NVIDIA driver regression with vLLM
|
10-07-2026, 01:42 AM
Quote:A couple questions before I guess too hard. Are you testing this on B200 or something else? My first guess would be this: Start by verifying the driver/runtime combo, then test with a smaller prompt, then look at tokens/sec. A lot of these threads end up being one bad config plus a pile of conclusions drawn from it.
learning in public
|
|
« Next Oldest | Next Newest »
|
| Messages In This Thread |
|
NVIDIA driver regression with vLLM - by audiopath66 - 10-05-2026, 04:17 AM
Re: NVIDIA driver regression with vLLM - by mintforge - 10-05-2026, 12:24 PM
Re: NVIDIA driver regression with vLLM - by orbitbench6 - 10-05-2026, 01:03 PM
Re: NVIDIA driver regression with vLLM - by phaseport36 - 10-16-2026, 11:20 AM
Re: NVIDIA driver regression with vLLM - by paperport64 - 10-07-2026, 01:42 AM
Re: NVIDIA driver regression with vLLM - by phaseport36 - 10-10-2026, 01:56 AM
Re: NVIDIA driver regression with vLLM - by dockember - 10-10-2026, 10:22 AM
Re: NVIDIA driver regression with vLLM - by relaynest82 - 10-13-2026, 10:47 AM
Re: NVIDIA driver regression with vLLM - by mintforge - 10-16-2026, 02:11 PM
Re: NVIDIA driver regression with vLLM - by cobaltspark - 10-16-2026, 10:47 AM
Re: NVIDIA driver regression with vLLM - by audiopath66 - 10-16-2026, 12:01 PM
Re: NVIDIA driver regression with vLLM - by sparrowkite53 - 10-18-2026, 02:54 AM
|
