10-13-2026, 07:11 PM
Spent some time on this today and wanted to compare notes.
I've gone back and forth between SGLang and MLX for Llama. The interesting difference for me has been embeddings.
What would you pick if you had to live with it for a few months?
This is mostly for local work rather than public serving.
I've gone back and forth between SGLang and MLX for Llama. The interesting difference for me has been embeddings.
What would you pick if you had to live with it for a few months?
This is mostly for local work rather than public serving.
curious and caffeinated