+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Edge AI & Gadgets (https://www.datasculpting.ai/inference/forumdisplay.php?fid=21)
+--- Forum: SBCs / Mini PCs (https://www.datasculpting.ai/inference/forumdisplay.php?fid=74)
+--- Thread: best mini PC for local use: early impressions (/showthread.php?tid=1472)
Pages:
1
2
Re: best mini PC for local use: early impressions - phasespark - 10-19-2026
Appreciate the detail. That matches what I saw on Threadripper box. Worth rechecking your defaults though, because one bad assumption can make the rest of the thread look confusing.
Re: best mini PC for local use: early impressions - byteyard - 10-19-2026
Interesting, I hadn't tried that. I ended up in about the same place using SGLang.
Re: best mini PC for local use: early impressions - homelabhenry - 10-19-2026
Maybe, but I had the opposite result. I get why that seems right, but on Threadripper box the bottleneck felt elsewhere. Not saying you're wrong, just that I wouldn't lock that in as the lesson yet.
best mini PC for local use: early impressions - homelabhenry - 10-19-2026
Spent some time on this today and wanted to compare notes.
I'm comparing two approaches here: keep it simple on A6000, or squeeze more out of the stack and deal with the complexity.
What would you pick if you had to live with it for a few months?
This is mostly for local work rather than public serving.
Re: best mini PC for local use: early impressions - dockkite69 - 10-19-2026
What exact setup are you running? Is this local-only or are you routing anything externally?
Re: best mini PC for local use: early impressions - cobalttinker - 10-19-2026
A couple things I'd check first. If you're on MLX, I'd confirm the version first and then reduce variables until the behavior is obvious. Not glamorous advice, but repeatable baselines save a lot of time.