09-13-2026, 05:51 PM
Ran a quick check on my box. On 7900 XTX with MLX, I saw basically the same behavior. The surprise was that memory pressure showed up before throughput collapsed.
throughput matters, but tail latency matters too