Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
M3 Max for local use for DeepSeek
#11
Maybe, but I had the opposite result. I've seen people blame long context when the real issue was much more mundane.
M3 Max • MLX • local-first
Reply
#12
Quote:Maybe, but I had the opposite result. I've seen people blame long context when the real issue was much more mundane.

My first guess would be this: On A6000, the easiest win is often to back off the aggressive settings and see whether the problem survives. Once you know the plain path works, then add the faster path back in piece by piece.
Reply
#13
Thanks, that helps. That matches what I saw on 7900 XTX. Worth rechecking your defaults though, because one bad assumption can make the rest of the thread look confusing. The logs were somehow calmer than I was.
Reply
#14
What worked for me was pretty simple. On GB200, the easiest win is often to back off the aggressive settings and see whether the problem survives. Not glamorous advice, but repeatable baselines save a lot of time.
Reply
#15
I tested this tonight. My result was mixed: first run looked bad, second run looked normal. The main thing that moved was latency, not quality.
Apple Silicon • MLX mostly
Reply


Forum Jump:


Users browsing this thread: 2 Guest(s)