Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
quiet dual-GPU build advice for Mixtral
#1
Posting this in case it saves someone else a little time.

I'm not trying to build a perfect architecture diagram. I just want a sane starting point around vLLM and M3 Max.

Would rather learn from your scars than collect my own all at once.

This is mostly for local work rather than public serving.
Apple Silicon • MLX mostly
Reply


Messages In This Thread
quiet dual-GPU build advice for Mixtral - by labnest - 10-13-2026, 11:03 PM

Forum Jump:


Users browsing this thread: 1 Guest(s)