+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Edge AI & Gadgets (https://www.datasculpting.ai/inference/forumdisplay.php?fid=21)
+--- Forum: SBCs / Mini PCs (https://www.datasculpting.ai/inference/forumdisplay.php?fid=74)
+--- Thread: Jetson still a thing with MLX (/showthread.php?tid=1152)
Jetson still a thing with MLX - cobalttinker - 10-13-2026
Thought I'd post a small recipe because a lot of threads ask similar things.
This isn't revolutionary, but the combination of MLX and M3 Max felt surprisingly usable once I tuned around KV cache pressure.
If someone wants the exact settings I can clean them up and post them.
This is mostly for local work rather than public serving.
Re: Jetson still a thing with MLX - cacheplane98 - 10-13-2026
Quote:Thought I'd post a small recipe because a lot of threads ask similar things.
Need a little more detail here. Is this local-only or are you routing anything externally?
Re: Jetson still a thing with MLX - mintquill - 10-13-2026
Quote:Quote:Thought I'd post a small recipe because a lot of threads ask similar things.
following this because I'm in the same boat.
Re: Jetson still a thing with MLX - promptfield - 10-14-2026
Tried to reproduce it just now. My result was mixed: first run looked bad, second run looked normal. I expected the model choice to matter more than it did.
Re: Jetson still a thing with MLX - homelabhenry - 10-14-2026
A couple things I'd check first. If you're on LM Studio, I'd confirm the version first and then reduce variables until the behavior is obvious. A lot of these threads end up being one bad config plus a pile of conclusions drawn from it.
Re: Jetson still a thing with MLX - cobalttinker - 10-14-2026
subscribed, curious where this lands.