+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Drivers / Frameworks / Toolkits (https://www.datasculpting.ai/inference/forumdisplay.php?fid=8)
+--- Forum: Apple / MLX (https://www.datasculpting.ai/inference/forumdisplay.php?fid=33)
+--- Thread: best local stack on mac right now on M3 Max (/showthread.php?tid=458)
best local stack on mac right now on M3 Max - mlxgarden - 09-25-2026
I'm trying to sanity-check my setup.
I'm trying to decide whether to keep the current stack or change course. Main question is how people here are handling reranking.
Not looking for the perfect answer, mostly what worked in real use.
Re: best local stack on mac right now on M3 Max - llmtrack26 - 09-25-2026
I tested this tonight. My result was mixed: first run looked bad, second run looked normal. The main thing that moved was latency, not quality.
Re: best local stack on mac right now on M3 Max - sanescope - 09-26-2026
subscribed, curious where this lands.
Re: best local stack on mac right now on M3 Max - labnest - 09-26-2026
Appreciate the detail. I don't think your conclusion is far off. The biggest change for me was simplifying the stack instead of adding one more optimization layer.
If you post your exact settings, people here can probably narrow it down pretty fast.
Re: best local stack on mac right now on M3 Max - quantsupply - 09-27-2026
A couple things I'd check first. On mini PC, the easiest win is often to back off the aggressive settings and see whether the problem survives.
Re: best local stack on mac right now on M3 Max - kernelarch - 09-27-2026
Thanks, that helps. That matches what I saw on 5090.
Re: best local stack on mac right now on M3 Max - pixelcrate82 - 09-27-2026
My first guess would be this: If you're on llama.cpp, I'd confirm the version first and then reduce variables until the behavior is obvious. Not glamorous advice, but repeatable baselines save a lot of time.