10-03-2026, 08:51 AM
Quote:My first guess would be this: If you're on MLX, I'd confirm the version first and then reduce variables until the behavior is obvious. A lot of these
Tried to reproduce it just now. I couldn't reproduce the slowdown until I pushed context much higher. The surprise was that memory pressure showed up before throughput collapsed.
routing beats arguing over one perfect model