what changed after the inference shift with MLX

[cudapeak]

Did a small comparison this afternoon. On A6000 with vLLM, I saw basically the same behavior. The surprise was that memory pressure showed up before t

A couple things I'd check first. Before rebuilding anything, I'd test one clean baseline with Mistral and compare from there.