Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
RTX 5090 local inference on M3 Max
#8
Spent some time on this today and wanted to compare notes.

Two paths both seem viable, but they break down differently once MoE serving becomes important.

Interested in tradeoffs more than fan loyalty.

This is mostly for local work rather than public serving.

If I had to summarize the lesson so far, it would be that clean setup and observability beat clever guesses.
Reply


Messages In This Thread
RTX 5090 local inference on M3 Max - by thetarunner - 10-19-2026, 05:32 AM

Forum Jump:


Users browsing this thread: 1 Guest(s)