+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Apps / Utilities / Tools (https://www.datasculpting.ai/inference/forumdisplay.php?fid=18)
+--- Forum: Local (https://www.datasculpting.ai/inference/forumdisplay.php?fid=20)
+--- Thread: desktop apps around local AI (/showthread.php?tid=440)
desktop apps around local AI - quiettoken - 09-24-2026
Spent some time on this today and wanted to compare notes.
Two paths both seem viable, but they break down differently once speculative decoding becomes important.
Interested in tradeoffs more than fan loyalty.
Re: desktop apps around local AI - thetaplane - 09-24-2026
A couple things I'd check first. Before rebuilding anything, I'd test one clean baseline with Mistral and compare from there. Not glamorous advice, but repeatable baselines save a lot of time.
Re: desktop apps around local AI - vectorcrate98 - 09-24-2026
That matches what I was seeing. That matches what I saw on dual 3090.