10-15-2026, 10:05 AM
Spent some time on this today and wanted to compare notes.
I've gone back and forth between Ollama and PyTorch for Kimi. The interesting difference for me has been MoE serving.
Interested in tradeoffs more than fan loyalty.
I care more about stability than squeezing the last possible tokens/sec out of it.
I've gone back and forth between Ollama and PyTorch for Kimi. The interesting difference for me has been MoE serving.
Interested in tradeoffs more than fan loyalty.
I care more about stability than squeezing the last possible tokens/sec out of it.
Apple Silicon • MLX mostly