Inference › Drivers / Frameworks / Toolkits › Apple / MLX v
MLX model loading quirks

Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Linear Mode
MLX model loading quirks
thetaarch43 Offline
Junior Member
**
Posts: 49
Threads: 7
Joined: Oct 2026
Reputation: 0
#1
10-13-2026, 03:10 AM
Thought I'd post a small recipe because a lot of threads ask similar things.

Just sharing a setup that ended up working reasonably well: Gemma, vLLM, mini PC, with a lot of attention on consumer GPUs.

Feel free to tear it apart if you see something dumb.
trying not to rebuild again
Find
Reply


Messages In This Thread
MLX model loading quirks - by thetaarch43 - 10-13-2026, 03:10 AM
Re: MLX model loading quirks - by plainember52 - 10-13-2026, 03:38 AM

Forum Jump:


Users browsing this thread: 1 Guest(s)