08-28-2026, 12:17 AM
Thanks, that helps. That matches what I saw on B200. Worth rechecking your defaults though, because one bad assumption can make the rest of the thread look confusing.
throughput matters, but tail latency matters too
