10-12-2026, 10:03 PM
Spent some time on this today and wanted to compare notes.
I've gone back and forth between TensorRT-LLM and TensorRT-LLM for Llama. The interesting difference for me has been reranking.
Interested in tradeoffs more than fan loyalty.
My use case is pretty ordinary: local chat, some document work, and occasional batch jobs.
I've gone back and forth between TensorRT-LLM and TensorRT-LLM for Llama. The interesting difference for me has been reranking.
Interested in tradeoffs more than fan loyalty.
My use case is pretty ordinary: local chat, some document work, and occasional batch jobs.