10-07-2026, 10:39 PM
Spent some time on this today and wanted to compare notes.
I've gone back and forth between MLX and llama.cpp for Mistral. The interesting difference for me has been MoE serving.
What would you pick if you had to live with it for a few months?
I've gone back and forth between MLX and llama.cpp for Mistral. The interesting difference for me has been MoE serving.
What would you pick if you had to live with it for a few months?
M3 Max • MLX • local-first