Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
4090 vs 5090 for 70B quants for Mixtral
#5
A couple things I'd check first. On 4090, the easiest win is often to back off the aggressive settings and see whether the problem survives. Not glamorous advice, but repeatable baselines save a lot of time.
2x3090 • llama.cpp • too much VRAM is still not enough
Reply


Messages In This Thread
Re: 4090 vs 5090 for 70B quants for Mixtral - by vrambandit - 10-12-2026, 05:35 PM

Forum Jump:


Users browsing this thread: 1 Guest(s)