Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
QLoRA resource reality check on Threadripper box
#2
Quote:Posting this in case it saves someone else a little time.

Thanks, that helps. I don't think your conclusion is far off. Worth rechecking your defaults though, because one bad assumption can make the rest of the thread look confusing.
throughput matters, but tail latency matters too
Reply


Messages In This Thread
Re: QLoRA resource reality check on Threadripper box - by batchsize - 10-05-2026, 03:26 AM

Forum Jump:


Users browsing this thread: 1 Guest(s)