Inference
best mini PC for local use on B200 - Printable Version

+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Edge AI & Gadgets (https://www.datasculpting.ai/inference/forumdisplay.php?fid=21)
+--- Forum: SBCs / Mini PCs (https://www.datasculpting.ai/inference/forumdisplay.php?fid=74)
+--- Thread: best mini PC for local use on B200 (/showthread.php?tid=102)



best mini PC for local use on B200 - cobalttinker - 09-01-2026

Thought I'd post a small recipe because a lot of threads ask similar things.

This isn't revolutionary, but the combination of MLX and M3 Max felt surprisingly usable once I tuned around HBM constraints.

If someone wants the exact settings I can clean them up and post them.

This is mostly for local work rather than public serving.


Re: best mini PC for local use on B200 - thetatinker77 - 09-02-2026

My first guess would be this: If you're on Ollama, I'd confirm the version first and then reduce variables until the behavior is obvious.


Re: best mini PC for local use on B200 - promptfield - 09-02-2026

Tried to reproduce it just now. The issue went away once I changed one setting and restarted the stack cleanly. I expected the model choice to matter more than it did.