09-25-2026, 08:32 PM
A couple things I'd check first. If you're on vLLM, I'd confirm the version first and then reduce variables until the behavior is obvious. Turns out 'just one more test' was a lie.
M3 Max • MLX • local-first
|
MLX model loading quirks
|
|
« Next Oldest | Next Newest »
|
| Messages In This Thread |
|
MLX model loading quirks - by pixelcrate82 - 09-22-2026, 06:19 PM
Re: MLX model loading quirks - by mellowstream - 09-22-2026, 07:31 PM
Re: MLX model loading quirks - by sanescope - 09-25-2026, 07:32 PM
Re: MLX model loading quirks - by mlxgarden - 09-25-2026, 08:32 PM
Re: MLX model loading quirks - by circuitwire58 - 09-26-2026, 01:09 AM
Re: MLX model loading quirks - by thetaarch43 - 09-27-2026, 01:10 PM
Re: MLX model loading quirks - by dockridge - 09-27-2026, 02:03 PM
|