+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Drivers / Frameworks / Toolkits (https://www.datasculpting.ai/inference/forumdisplay.php?fid=8)
+--- Forum: Apple / MLX (https://www.datasculpting.ai/inference/forumdisplay.php?fid=33)
+--- Thread: M3 Max for local use (/showthread.php?tid=245)
M3 Max for local use - cudacrate - 09-13-2026
Curious what people here are seeing.
I'm mostly working with Mixtral in SGLang on A6000. The part I'm trying to understand is KV cache pressure.
Would appreciate practical advice rather than theory.
This is mostly for local work rather than public serving.
Re: M3 Max for local use - mellowstream - 09-13-2026
I'd start with the simpler stack.
I'm happy to test one more variant if you want a second data point.