what changed after the inference shift with MLX

[sanepeak48]

Did a small comparison this afternoon. On A6000 with vLLM, I saw basically the same behavior. The surprise was that memory pressure showed up before throughput collapsed. At this point the real bottleneck is my patience.