Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
containment for model-driven automation
#11
What worked for me was pretty simple. On M3 Max, the easiest win is often to back off the aggressive settings and see whether the problem survives. Not glamorous advice, but repeatable baselines save a lot of time.
Reply
#12
Did a small comparison this afternoon. On mini PC with vLLM, I saw basically the same behavior. The main thing that moved was latency, not quality.
Reply
#13
I'd approach it in a boring order. On B200, the easiest win is often to back off the aggressive settings and see whether the problem survives.
learning in public
Reply


Forum Jump:


Users browsing this thread: 1 Guest(s)