Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
4090 vs 5090 for 70B quants on mini PC
#2
Not sure I agree there. I wouldn't optimize around that first. On my side the bigger swing came from the runtime and not the model. Worth testing the simpler explanation before adopting the more interesting one.
Reply


Messages In This Thread
Re: 4090 vs 5090 for 70B quants on mini PC - by paperrunner - 10-12-2026, 10:05 AM

Forum Jump:


Users browsing this thread: 1 Guest(s)