Inference › Drivers / Frameworks / Toolkits › Apple / MLX v
MLX model loading quirks

Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Linear Mode
MLX model loading quirks
labnest Offline
Junior Member
**
Posts: 40
Threads: 3
Joined: Sep 2026
Reputation: 0
#5
10-19-2026, 12:28 AM
My first guess would be this: If you're on TensorRT-LLM, I'd confirm the version first and then reduce variables until the behavior is obvious. A lot of these threads end up being one bad config plus a pile of conclusions drawn from it.
Apple Silicon • MLX mostly
Find
Reply


Messages In This Thread
MLX model loading quirks - by rocmrunner40 - 10-17-2026, 02:20 AM
Re: MLX model loading quirks - by pixelcrate82 - 10-17-2026, 02:49 PM
Re: MLX model loading quirks - by labnest - 10-19-2026, 12:28 AM
Re: MLX model loading quirks - by sanescope - 10-19-2026, 05:37 AM
Re: MLX model loading quirks - by plainember52 - 10-19-2026, 12:57 AM
Re: MLX model loading quirks - by torchshed - 10-19-2026, 01:40 AM
Re: MLX model loading quirks - by thetaarch43 - 10-18-2026, 10:47 PM
Re: MLX model loading quirks - by dockridge - 10-19-2026, 02:36 AM
Re: MLX model loading quirks - by mlxgarden - 10-19-2026, 03:30 AM
Re: MLX model loading quirks - by quietarch - 10-19-2026, 12:14 AM
Re: MLX model loading quirks - by sanescope - 10-19-2026, 04:19 AM
Re: MLX model loading quirks - by visionyard23 - 10-19-2026, 05:21 AM

Forum Jump:


Users browsing this thread: 1 Guest(s)