+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Drivers / Frameworks / Toolkits (https://www.datasculpting.ai/inference/forumdisplay.php?fid=8)
+--- Forum: Apple / MLX (https://www.datasculpting.ai/inference/forumdisplay.php?fid=33)
+--- Thread: best local stack on mac right now (/showthread.php?tid=1457)
Pages:
1
2
Re: best local stack on mac right now - visionyard23 - 10-19-2026
I hit almost the same issue last night.
I'm happy to test one more variant if you want a second data point.
Re: best local stack on mac right now - turboyard94 - 10-19-2026
I think the bottleneck is somewhere else. I wouldn't optimize around that first. On my side the bigger swing came from the runtime and not the model. Not saying you're wrong, just that I wouldn't lock that in as the lesson yet.
Re: best local stack on mac right now - mlxgarden - 10-19-2026
same here on my side.
Re: best local stack on mac right now - thetaarch43 - 10-19-2026
Need a little more detail here. Do you see the same thing with a smaller batch or shorter prompt?
Re: best local stack on mac right now - circuitwire58 - 10-19-2026
Did a small comparison this afternoon. I couldn't reproduce the slowdown until I pushed context much higher. The surprise was that memory pressure showed up before throughput collapsed.