when TensorRT-LLM clearly wins on 5090

[routecrate]

I'd approach it in a boring order. Before rebuilding anything, I'd test one clean baseline with Mixtral and compare from there. A lot of these threads

Interesting, I hadn't tried that. The pattern around KV cache pressure has been pretty similar for me.