Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
rackmount vs tower for homelab inference
#1
Spent some time on this today and wanted to compare notes.

I've gone back and forth between MLX and Ollama for Llama. The interesting difference for me has been HBM constraints.

What would you pick if you had to live with it for a few months?
Reply


Messages In This Thread
rackmount vs tower for homelab inference - by latentpeak22 - 10-12-2026, 05:21 PM

Forum Jump:


Users browsing this thread: 1 Guest(s)