Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
4090 vs 5090 for 70B quants for Mixtral
#9
Quote:Good point. That matches what I saw on Threadripper box.

A couple things I'd check first. On 5090, the easiest win is often to back off the aggressive settings and see whether the problem survives. Not glamorous advice, but repeatable baselines save a lot of time.
Mostly CUDA, sometimes wrong, usually measured
Reply


Messages In This Thread
Re: 4090 vs 5090 for 70B quants for Mixtral - by kernelmike - 10-13-2026, 03:39 AM

Forum Jump:


Users browsing this thread: 1 Guest(s)