Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
odd little inference appliances with MLX
#1
Did a bit of testing and thought I'd post the result here.

After a few runs on 7900 XTX, I ended up with decent performance, but the setup only really made sense once I adjusted around small local stacks.

Happy to post more details if anyone wants them.

This is mostly for local work rather than public serving.
team red, team patient
Reply


Messages In This Thread
odd little inference appliances with MLX - by mintquill - 10-05-2026, 08:52 PM

Forum Jump:


Users browsing this thread: 1 Guest(s)