latency vs throughput for small deployments with TensorRT-LLM

[stackarch]

Maybe, but I had the opposite result. I get why that seems right, but on B200 the bottleneck felt elsewhere. Worth testing the simpler explanation before adopting the more interesting one. I keep promising myself this is the last rebuild.