+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Evaluation & Testing (https://www.datasculpting.ai/inference/forumdisplay.php?fid=16)
+--- Forum: Quality / Reliability Testing (https://www.datasculpting.ai/inference/forumdisplay.php?fid=68)
+--- Thread: video model setup pain points on GB200 (/showthread.php?tid=670)
Pages:
1
2
Re: video model setup pain points on GB200 - routecraft - 10-10-2026
Good point. That matches what I saw on mini PC. The biggest change for me was simplifying the stack instead of adding one more optimization layer.
Re: video model setup pain points on GB200 - mangotinker73 - 10-11-2026
Thanks, that helps. I ended up in about the same place using MLX. I got better results once I stopped chasing one metric and just looked at whether the workflow felt usable.
There are a few different conversations hiding inside this thread, so being explicit about the goal helps.
Re: video model setup pain points on GB200 - llmarch51 - 10-11-2026
I'd approach it in a boring order. Start by verifying the driver/runtime combo, then test with a smaller prompt, then look at continuous batching.
Re: video model setup pain points on GB200 - cozygrid12 - 10-11-2026
Not sure I agree there. The reported numbers can look compelling, but in ordinary usage I didn't see the same benefit. Worth testing the simpler explanation before adopting the more interesting one.