what changed after the inference shift with MLX

[turboscope5]

This keeps coming up in conversation so I figured I'd start a thread.

The more I work with local setups, the more it seems like consumer GPUs decides everything downstream.

Wondering if this is just where the whole space is heading now.

I care more about stability than squeezing the last possible tokens/sec out of it.