QLoRA resource reality check on Threadripper box

Thread Rating:

0 Vote(s) - 0 Average
1
2
3
4
5

Linear Mode

QLoRA resource reality check on Threadripper box

batchsize Offline

Offline

Member

Posts: 137
Threads: 16
Joined: Sep 2026
Reputation: 0

#4

09-25-2026, 05:23 AM

worth checking the driver first.

throughput matters, but tail latency matters too

Find

Reply

« Next Oldest | Next Newest »

Messages In This Thread

QLoRA resource reality check on Threadripper box - by turboyard94 - 09-24-2026, 07:45 PM

Re: QLoRA resource reality check on Threadripper box - by cacheline - 09-25-2026, 04:07 AM

Re: QLoRA resource reality check on Threadripper box - by deltastation - 09-25-2026, 04:36 AM

Re: QLoRA resource reality check on Threadripper box - by batchsize - 09-25-2026, 05:23 AM

Re: QLoRA resource reality check on Threadripper box - by cacheline - 09-25-2026, 01:54 PM

Re: QLoRA resource reality check on Threadripper box - by batchsize - 09-25-2026, 02:27 PM

Re: QLoRA resource reality check on Threadripper box - by sanevault - 09-25-2026, 02:48 PM

Re: QLoRA resource reality check on Threadripper box - by deltastation - 09-25-2026, 07:36 PM

Re: QLoRA resource reality check on Threadripper box - by nanobrook - 09-25-2026, 09:16 PM

Re: QLoRA resource reality check on Threadripper box - by kernelghost - 09-26-2026, 09:59 AM

Re: QLoRA resource reality check on Threadripper box - by quiethouse - 09-27-2026, 10:03 PM

View a Printable Version

Forum Jump:

Users browsing this thread: 1 Guest(s)