Inference
multimodal local stack that feels real on GB200 - Printable Version

+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Generative AI (https://www.datasculpting.ai/inference/forumdisplay.php?fid=17)
+--- Forum: Video (https://www.datasculpting.ai/inference/forumdisplay.php?fid=70)
+--- Thread: multimodal local stack that feels real on GB200 (/showthread.php?tid=789)

Pages: 1 2


Re: multimodal local stack that feels real on GB200 - cobalttinker - 10-09-2026

Need a little more detail here. Are you testing this on Threadripper box or something else?


Re: multimodal local stack that feels real on GB200 - visionforge - 10-11-2026

Interesting, I hadn't tried that. That matches what I saw on B200. I got better results once I stopped chasing one metric and just looked at whether the workflow felt usable.


Re: multimodal local stack that feels real on GB200 - cachelab - 10-11-2026

worth checking the driver first.


Re: multimodal local stack that feels real on GB200 - quantshed - 10-11-2026

Good point. That matches what I saw on 7900 XTX.