10-13-2026, 06:41 AM
Thought I'd post a small recipe because a lot of threads ask similar things.
This isn't revolutionary, but the combination of MLX and M3 Max felt surprisingly usable once I tuned around KV cache pressure.
If someone wants the exact settings I can clean them up and post them.
This is mostly for local work rather than public serving.
This isn't revolutionary, but the combination of MLX and M3 Max felt surprisingly usable once I tuned around KV cache pressure.
If someone wants the exact settings I can clean them up and post them.
This is mostly for local work rather than public serving.