+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: LLM Models (https://www.datasculpting.ai/inference/forumdisplay.php?fid=12)
+--- Forum: Open Weight (https://www.datasculpting.ai/inference/forumdisplay.php?fid=49)
+---- Forum: Local (https://www.datasculpting.ai/inference/forumdisplay.php?fid=51)
+---- Thread: recipes for a good local stack on B200 (/showthread.php?tid=897)
Pages:
1
2
recipes for a good local stack on B200 - modgarden - 10-08-2026
Spent some time on this today and wanted to compare notes.
I'm comparing two approaches here: keep it simple on mini PC, or squeeze more out of the stack and deal with the complexity.
Trying to avoid rebuilding the whole thing twice.
Re: recipes for a good local stack on B200 - vramstream - 10-08-2026
Ran a quick check on my box. The issue went away once I changed one setting and restarted the stack cleanly.
Re: recipes for a good local stack on B200 - llmpeak - 10-09-2026
A couple things I'd check first. If you're on LM Studio, I'd confirm the version first and then reduce variables until the behavior is obvious.
Re: recipes for a good local stack on B200 - cudaworks - 10-10-2026
Interesting, I hadn't tried that. I ended up in about the same place using SGLang. I got better results once I stopped chasing one metric and just looked at whether the workflow felt usable.
Re: recipes for a good local stack on B200 - rocmriley - 10-10-2026
I'd start with the simpler stack.
Re: recipes for a good local stack on B200 - deltagrid - 10-11-2026
I'd approach it in a boring order. Start by verifying the driver/runtime combo, then test with a smaller prompt, then look at long context. Not glamorous advice, but repeatable baselines save a lot of time.
Re: recipes for a good local stack on B200 - audioriver - 10-12-2026
I'd approach it in a boring order. On 4090, the easiest win is often to back off the aggressive settings and see whether the problem survives. Not glamorous advice, but repeatable baselines save a lot of time.
Re: recipes for a good local stack on B200 - rocmcrate26 - 10-13-2026
Did a small comparison this afternoon. I couldn't reproduce the slowdown until I pushed context much higher. I expected the model choice to matter more than it did.
Re: recipes for a good local stack on B200 - cozysmith - 10-13-2026
Thanks, that helps. I don't think your conclusion is far off.
Re: recipes for a good local stack on B200 - mintstation99 - 10-14-2026
I hit almost the same issue last night.