QLoRA resource reality check on A6000

Thread Rating:

0 Vote(s) - 0 Average
1
2
3
4
5

Linear Mode

QLoRA resource reality check on A6000

batchsize Offline

Offline

Member

Posts: 137
Threads: 16
Joined: Sep 2026
Reputation: 0

#6

09-27-2026, 06:13 AM

that fixed it for me too.

If you post your exact settings, people here can probably narrow it down pretty fast.

throughput matters, but tail latency matters too

Find

Reply

« Next Oldest | Next Newest »

Messages In This Thread

QLoRA resource reality check on A6000 - by deltastation - 09-26-2026, 12:12 AM

Re: QLoRA resource reality check on A6000 - by cacheline - 09-26-2026, 01:14 AM

Re: QLoRA resource reality check on A6000 - by flintriver50 - 09-27-2026, 01:29 AM

Re: QLoRA resource reality check on A6000 - by cudascope - 09-27-2026, 01:49 AM

Re: QLoRA resource reality check on A6000 - by cacheline - 10-01-2026, 08:15 PM

Re: QLoRA resource reality check on A6000 - by macropoint - 09-27-2026, 05:53 AM

Re: QLoRA resource reality check on A6000 - by batchsize - 09-27-2026, 06:13 AM

Re: QLoRA resource reality check on A6000 - by kernelghost - 09-30-2026, 07:02 AM

Re: QLoRA resource reality check on A6000 - by cudascope - 10-01-2026, 07:14 PM

Re: QLoRA resource reality check on A6000 - by circuitworks90 - 10-02-2026, 04:28 AM

Re: QLoRA resource reality check on A6000 - by batchpeak - 10-02-2026, 05:39 AM

Re: QLoRA resource reality check on A6000 - by routearch - 10-05-2026, 05:53 AM

Re: QLoRA resource reality check on A6000 - by kernelghost - 10-05-2026, 05:56 PM

View a Printable Version

Forum Jump:

Users browsing this thread: 1 Guest(s)