+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Apps / Utilities / Tools (https://www.datasculpting.ai/inference/forumdisplay.php?fid=18)
+--- Forum: Local (https://www.datasculpting.ai/inference/forumdisplay.php?fid=20)
+--- Thread: desktop apps around local AI (/showthread.php?tid=453)
desktop apps around local AI - modgarden - 09-25-2026
Spent some time on this today and wanted to compare notes.
Two paths both seem viable, but they break down differently once MoE serving becomes important.
What would you pick if you had to live with it for a few months?
I care more about stability than squeezing the last possible tokens/sec out of it.
Re: desktop apps around local AI - relayforge - 09-25-2026
What worked for me was pretty simple. Before rebuilding anything, I'd test one clean baseline with Mixtral and compare from there.