10-10-2026, 07:12 PM
Spent some time on this today and wanted to compare notes.
I've gone back and forth between Ollama and SGLang for Llama. The interesting difference for me has been tokens/sec.
Interested in tradeoffs more than fan loyalty.
This is mostly for local work rather than public serving.
I've gone back and forth between Ollama and SGLang for Llama. The interesting difference for me has been tokens/sec.
Interested in tradeoffs more than fan loyalty.
This is mostly for local work rather than public serving.
image models by night, local pipelines by day