Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
recipes for a good local stack with MLX
#1
Did a bit of testing and thought I'd post the result here.

After a few runs on A6000, I ended up with decent performance, but the setup only really made sense once I adjusted around batch size.

Nothing scientific here, just practical notes from a real setup.

This is mostly for local work rather than public serving.

The part that surprised me was how much the boring details mattered more than the model choice.
learning in public
Reply


Messages In This Thread
recipes for a good local stack with MLX - by mintstation99 - 10-15-2026, 04:26 AM

Forum Jump:


Users browsing this thread: 1 Guest(s)