Inference
what are you all running this week on GB200 - Printable Version

+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Miscellaneous Discussion (https://www.datasculpting.ai/inference/forumdisplay.php?fid=24)
+--- Forum: General (https://www.datasculpting.ai/inference/forumdisplay.php?fid=25)
+--- Thread: what are you all running this week on GB200 (/showthread.php?tid=1185)

Pages: 1 2


Re: what are you all running this week on GB200 - ggufwire22 - 10-19-2026

A couple things I'd check first. Start by verifying the driver/runtime combo, then test with a smaller prompt, then look at NVFP4. Not glamorous advice, but repeatable baselines save a lot of time.


Re: what are you all running this week on GB200 - thetaember38 - 10-19-2026

A couple things I'd check first. Before rebuilding anything, I'd test one clean baseline with Kimi and compare from there.


Re: what are you all running this week on GB200 - tensorkite - 10-19-2026

Can you fill in a bit more context? What model, what runtime, and roughly what context size?