10-19-2026, 04:59 AM
Quote:I tested this tonight. On B200 with MLX, I saw basically the same behavior.
What exact setup are you running? What model, what runtime, and roughly what context size?
Mostly CUDA, sometimes wrong, usually measured
