10-05-2026, 05:19 AM
Spent some time on this today and wanted to compare notes.
I've gone back and forth between TensorRT-LLM and TensorRT-LLM for Llama. The interesting difference for me has been quant drift.
Interested in tradeoffs more than fan loyalty.
I've gone back and forth between TensorRT-LLM and TensorRT-LLM for Llama. The interesting difference for me has been quant drift.
Interested in tradeoffs more than fan loyalty.