Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
quant choices for 70B local with PyTorch
#8
I don't think that's the whole story. I've seen people blame HBM constraints when the real issue was much more mundane.
post logs or it didn't happen
Reply


Messages In This Thread
Re: quant choices for 70B local with PyTorch - by benchplease - 10-18-2026, 09:15 PM

Forum Jump:


Users browsing this thread: 1 Guest(s)