Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
4090 vs 5090 for 70B quants on mini PC
#12
I think the bottleneck is somewhere else. I've seen people blame token cost when the real issue was much more mundane. Worth testing the simpler explanation before adopting the more interesting one.
Reply


Messages In This Thread
Re: 4090 vs 5090 for 70B quants on mini PC - by turboyard94 - 10-18-2026, 07:46 PM

Forum Jump:


Users browsing this thread: 1 Guest(s)