Inference
M3 Max for local use - Printable Version

+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Drivers / Frameworks / Toolkits (https://www.datasculpting.ai/inference/forumdisplay.php?fid=8)
+--- Forum: Apple / MLX (https://www.datasculpting.ai/inference/forumdisplay.php?fid=33)
+--- Thread: M3 Max for local use (/showthread.php?tid=332)

Pages: 1 2


Re: M3 Max for local use - thetaarch43 - 09-20-2026

I think the bottleneck is somewhere else. I get why that seems right, but on Threadripper box the bottleneck felt elsewhere.


Re: M3 Max for local use - sanescope - 09-20-2026

Can you fill in a bit more context? Is this local-only or are you routing anything externally?


Re: M3 Max for local use - pixelcrate82 - 09-20-2026

Appreciate the detail. I don't think your conclusion is far off. I got better results once I stopped chasing one metric and just looked at whether the workflow felt usable.