Inference
Blackwell deployment chatter: early impressions - Printable Version

+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Drivers / Frameworks / Toolkits (https://www.datasculpting.ai/inference/forumdisplay.php?fid=8)
+--- Forum: NVIDIA / CUDA (https://www.datasculpting.ai/inference/forumdisplay.php?fid=31)
+--- Thread: Blackwell deployment chatter: early impressions (/showthread.php?tid=556)



Blackwell deployment chatter: early impressions - dockember - 09-28-2026

Maybe I'm missing something obvious.

I'm trying to decide whether to keep the current stack or change course. Main question is how people here are handling prefill/decode split.

Would appreciate practical advice rather than theory.


Re: Blackwell deployment chatter: early impressions - dockember - 09-28-2026

What exact setup are you running? Are you testing this on B200 or something else?