+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Drivers / Frameworks / Toolkits (https://www.datasculpting.ai/inference/forumdisplay.php?fid=8)
+--- Forum: NVIDIA / CUDA (https://www.datasculpting.ai/inference/forumdisplay.php?fid=31)
+--- Thread: Blackwell deployment chatter (/showthread.php?tid=434)
Pages:
1
2
Re: Blackwell deployment chatter - phaseport36 - 09-28-2026
Can you fill in a bit more context? What model, what runtime, and roughly what context size?
Re: Blackwell deployment chatter - kernelmike - 09-29-2026
Quote:Can you fill in a bit more context? What model, what runtime, and roughly what context size?
Ran a quick check on my box. My result was mixed: first run looked bad, second run looked normal. The surprise was that memory pressure showed up before throughput collapsed.
Re: Blackwell deployment chatter - amberpatch25 - 09-29-2026
that fixed it for me too.
Re: Blackwell deployment chatter - latentgarden - 09-29-2026
I tested this tonight. The issue went away once I changed one setting and restarted the stack cleanly. The surprise was that memory pressure showed up before throughput collapsed.
Re: Blackwell deployment chatter - edgecoast - 09-29-2026
Tried to reproduce it just now. My result was mixed: first run looked bad, second run looked normal. I expected the model choice to matter more than it did.
If you post your exact settings, people here can probably narrow it down pretty fast.