+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Inference Engines (https://www.datasculpting.ai/inference/forumdisplay.php?fid=9)
+--- Forum: TensorRT-LLM (https://www.datasculpting.ai/inference/forumdisplay.php?fid=37)
+--- Thread: when TensorRT-LLM clearly wins on 5090 (/showthread.php?tid=1267)
Pages:
1
2
Re: when TensorRT-LLM clearly wins on 5090 - kernelmike - 10-19-2026
Quote:[quote]I'd approach it in a boring order. Before rebuilding anything, I'd test one clean baseline with Mixtral and compare from there. A lot of these
A couple things I'd check first. Before rebuilding anything, I'd test one clean baseline with Gemma and compare from there. Not glamorous advice, but repeatable baselines save a lot of time.
Re: when TensorRT-LLM clearly wins on 5090 - batchcraft - 10-19-2026
What exact setup are you running? Do you see the same thing with a smaller batch or shorter prompt?
Re: when TensorRT-LLM clearly wins on 5090 - amberpatch25 - 10-19-2026
I'd approach it in a boring order. Before rebuilding anything, I'd test one clean baseline with Mixtral and compare from there. A lot of these threads end up being one bad config plus a pile of conclusions drawn from it.
Re: when TensorRT-LLM clearly wins on 5090 - routecrate - 10-19-2026
Quote:I'd approach it in a boring order. Before rebuilding anything, I'd test one clean baseline with Mixtral and compare from there. A lot of these threads
Interesting, I hadn't tried that. The pattern around KV cache pressure has been pretty similar for me.