+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Drivers / Frameworks / Toolkits (https://www.datasculpting.ai/inference/forumdisplay.php?fid=8)
+--- Forum: Apple / MLX (https://www.datasculpting.ai/inference/forumdisplay.php?fid=33)
+--- Thread: MLX model loading quirks on mini PC (/showthread.php?tid=383)
MLX model loading quirks on mini PC - visionyard23 - 09-21-2026
Spent some time on this today and wanted to compare notes.
Two paths both seem viable, but they break down differently once INT4 becomes important.
Interested in tradeoffs more than fan loyalty.
My use case is pretty ordinary: local chat, some document work, and occasional batch jobs.
Re: MLX model loading quirks on mini PC - dockridge - 09-21-2026
Interesting, I hadn't tried that. The pattern around batch size has been pretty similar for me.