+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Optimization & Performance (https://www.datasculpting.ai/inference/forumdisplay.php?fid=10)
+--- Forum: Benchmarks (https://www.datasculpting.ai/inference/forumdisplay.php?fid=43)
+--- Thread: first LoRA that actually helped (/showthread.php?tid=12)
Pages:
1
2
first LoRA that actually helped - cacheline - 08-23-2026
Posting this in case it saves someone else a little time.
If you were starting from scratch today for this use case, what would you choose first and what would you ignore?
I'm especially interested in mistakes worth avoiding.
This is mostly for local work rather than public serving.
Re: first LoRA that actually helped - benchplease - 08-23-2026
A couple questions before I guess too hard. Is this local-only or are you routing anything externally?
Re: first LoRA that actually helped - mangohouse - 08-23-2026
A couple questions before I guess too hard. Are you testing this on 4090 or something else?
Re: first LoRA that actually helped - batchsize - 08-23-2026
I think the bottleneck is somewhere else. I've seen people blame HBM constraints when the real issue was much more mundane. Worth testing the simpler explanation before adopting the more interesting one.
I'm happy to test one more variant if you want a second data point.
Re: first LoRA that actually helped - griffinloom66 - 08-24-2026
Quote:I think the bottleneck is somewhere else. I've seen people blame HBM constraints when the real issue was much more mundane. Worth testing the simpler
Appreciate the detail. That matches what I saw on 5090. I got better results once I stopped chasing one metric and just looked at whether the workflow felt usable.
Re: first LoRA that actually helped - northgrid33 - 08-25-2026
Appreciate the detail. I don't think your conclusion is far off.
Re: first LoRA that actually helped - routecraft - 08-25-2026
A couple questions before I guess too hard. Do you see the same thing with a smaller batch or shorter prompt?
Re: first LoRA that actually helped - batchsize - 08-25-2026
Good point. I don't think your conclusion is far off. I got better results once I stopped chasing one metric and just looked at whether the workflow felt usable.
Re: first LoRA that actually helped - batchpeak - 08-27-2026
A couple things I'd check first. Before rebuilding anything, I'd test one clean baseline with DeepSeek and compare from there. A lot of these threads end up being one bad config plus a pile of conclusions drawn from it.
Re: first LoRA that actually helped - batchsize - 08-28-2026
Thanks, that helps. That matches what I saw on B200. Worth rechecking your defaults though, because one bad assumption can make the rest of the thread look confusing.