+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Drivers / Frameworks / Toolkits (https://www.datasculpting.ai/inference/forumdisplay.php?fid=8)
+--- Forum: NVIDIA / CUDA (https://www.datasculpting.ai/inference/forumdisplay.php?fid=31)
+--- Thread: NVIDIA driver regression (/showthread.php?tid=786)
NVIDIA driver regression - edgecoast - 10-05-2026
Thought I'd post a small recipe because a lot of threads ask similar things.
Maybe useful as a starting point: TensorRT-LLM on 7900 XTX, keeping HBM constraints in mind from the start.
If someone wants the exact settings I can clean them up and post them.
Re: NVIDIA driver regression - latentgarden - 10-07-2026
That matches what I was seeing. The pattern around token cost has been pretty similar for me. The biggest change for me was simplifying the stack instead of adding one more optimization layer.
Re: NVIDIA driver regression - kernelmike - 10-09-2026
Quote:That matches what I was seeing. The pattern around token cost has been pretty similar for me. The biggest change for me was simplifying the stack inst
I don't think that's the whole story. I wouldn't optimize around that first. On my side the bigger swing came from the runtime and not the model. Could be a workload difference, but I wouldn't generalize too fast from one setup.
Re: NVIDIA driver regression - mintforge - 10-09-2026
Quote:[quote]That matches what I was seeing. The pattern around token cost has been pretty similar for me. The biggest change for me was simplifying the sta
That matches what I was seeing. I don't think your conclusion is far off.
Re: NVIDIA driver regression - thetapath - 10-09-2026
Can you fill in a bit more context? Are you testing this on B200 or something else?
Re: NVIDIA driver regression - dockember - 10-10-2026
Quote:Can you fill in a bit more context? Are you testing this on B200 or something else?
Need a little more detail here. Are you testing this on 4090 or something else?
Re: NVIDIA driver regression - sparrowkite53 - 10-10-2026
Quote:Quote:Can you fill in a bit more context? Are you testing this on B200 or something else?
What worked for me was pretty simple. On Threadripper box, the easiest win is often to back off the aggressive settings and see whether the problem survives.
Re: NVIDIA driver regression - edgecoast - 10-10-2026
Quote:Quote:Quote:Can you fill in a bit more context? Are you testing this on B200 or something else?
My first guess would be this: Before rebuilding anything, I'd test one clean baseline with DeepSeek and compare from there. Not glamorous advice, but repeatable baselines save a lot of time.
Re: NVIDIA driver regression - emberrunner - 10-10-2026
Quote:Quote:Quote:Quote:Can you fill in a bit more context? Are you testing this on B200 or something else?
That matches what I was seeing. That matches what I saw on Threadripper box. The biggest change for me was simplifying the stack instead of adding one more optimization layer.
Re: NVIDIA driver regression - latentgarden - 10-11-2026
A couple things I'd check first. Before rebuilding anything, I'd test one clean baseline with FLUX and compare from there. Not glamorous advice, but repeatable baselines save a lot of time.