10-18-2026, 09:57 PM
Spent some time on this today and wanted to compare notes.
I've gone back and forth between llama.cpp and TensorRT-LLM for FLUX. The interesting difference for me has been tail latency.
Interested in tradeoffs more than fan loyalty.
I've gone back and forth between llama.cpp and TensorRT-LLM for FLUX. The interesting difference for me has been tail latency.
Interested in tradeoffs more than fan loyalty.