+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Drivers / Frameworks / Toolkits (https://www.datasculpting.ai/inference/forumdisplay.php?fid=8)
+--- Forum: Apple / MLX (https://www.datasculpting.ai/inference/forumdisplay.php?fid=33)
+--- Thread: M3 Max for local use for Mixtral (/showthread.php?tid=606)
M3 Max for local use for Mixtral - visionyard23 - 10-01-2026
Wanted to compare notes with people doing similar things.
My current setup is LM Studio with 7900 XTX, and I keep running into token cost.
Not looking for the perfect answer, mostly what worked in real use.
For context, I'm not chasing leaderboard numbers. I mostly want the system to feel consistent day to day.
I expected the biggest difference to come from the model, but the stack around it mattered at least as much.
Re: M3 Max for local use for Mixtral - quietarch - 10-01-2026
I think the bottleneck is somewhere else. I get why that seems right, but on A6000 the bottleneck felt elsewhere.
Re: M3 Max for local use for Mixtral - turboyard94 - 10-01-2026
Quote:I think the bottleneck is somewhere else. I get why that seems right, but on A6000 the bottleneck felt elsewhere.
Good point. That matches what I saw on 7900 XTX. Worth rechecking your defaults though, because one bad assumption can make the rest of the thread look confusing.
Re: M3 Max for local use for Mixtral - dockriver - 10-01-2026
subscribed, curious where this lands.
Re: M3 Max for local use for Mixtral - visionyard23 - 10-01-2026
Ran a quick check on my box. On dual 3090 with SGLang, I saw basically the same behavior. The surprise was that memory pressure showed up before throughput collapsed.
If you post your exact settings, people here can probably narrow it down pretty fast.
Re: M3 Max for local use for Mixtral - labnest - 10-02-2026
A couple questions before I guess too hard. Are you testing this on 5090 or something else?