latency vs throughput for small deployments with TensorRT-LLM

[rocmpath]

That matches what I was seeing. The pattern around quant drift has been pretty similar for me. The biggest change for me was simplifying the stack instead of adding one more optimization layer.