Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
quiet dual-GPU build advice for Mixtral
#11
worth checking the driver first.
Reply
#12
I tested this tonight. The issue went away once I changed one setting and restarted the stack cleanly.
Reply
#13
Tried to reproduce it just now. My result was mixed: first run looked bad, second run looked normal.
Reply
#14
That matches what I was seeing. The pattern around long context has been pretty similar for me. The biggest change for me was simplifying the stack instead of adding one more optimization layer.
Apple Silicon • MLX mostly
Reply
#15
subscribed, curious where this lands.
trying not to rebuild again
Reply


Forum Jump:


Users browsing this thread: 1 Guest(s)