10-16-2026, 03:09 PM
Quote:I tested this tonight. On GB200 with MLX, I saw basically the same behavior. The surprise was that memory pressure showed up before throughput collaps
Did a small comparison this afternoon. I couldn't reproduce the slowdown until I pushed context much higher.