Inference
Blackwell deployment chatter on B200 - Printable Version

+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Drivers / Frameworks / Toolkits (https://www.datasculpting.ai/inference/forumdisplay.php?fid=8)
+--- Forum: NVIDIA / CUDA (https://www.datasculpting.ai/inference/forumdisplay.php?fid=31)
+--- Thread: Blackwell deployment chatter on B200 (/showthread.php?tid=398)



Blackwell deployment chatter on B200 - edgecoast - 09-21-2026

This keeps coming up in conversation so I figured I'd start a thread.

The more I work with local setups, the more it seems like small local stacks decides everything downstream.

Curious whether that lines up with what other people are seeing.


Re: Blackwell deployment chatter on B200 - sparrowbrook - 09-22-2026

Quote:This keeps coming up in conversation so I figured I'd start a thread.

Tried to reproduce it just now. The issue went away once I changed one setting and restarted the stack cleanly. I expected the model choice to matter more than it did.


Re: Blackwell deployment chatter on B200 - dockember - 09-22-2026

A couple questions before I guess too hard. Is this local-only or are you routing anything externally?