10-14-2026, 09:36 PM
Spent some time on this today and wanted to compare notes.
I've gone back and forth between vLLM and llama.cpp for Llama. The interesting difference for me has been token cost.
Trying to avoid rebuilding the whole thing twice.
I've gone back and forth between vLLM and llama.cpp for Llama. The interesting difference for me has been token cost.
Trying to avoid rebuilding the whole thing twice.
