Inference › Optimization & Performance › Benchmarks v
QLoRA resource reality check with SGLang

Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Linear Mode
QLoRA resource reality check with SGLang
batchpeak Offline
Member
***
Posts: 52
Threads: 5
Joined: Aug 2026
Reputation: 0
#3
09-23-2026, 02:56 PM
My first guess would be this: On mini PC, the easiest win is often to back off the aggressive settings and see whether the problem survives. Not glamorous advice, but repeatable baselines save a lot of time.
trying not to rebuild again
Find
Reply


Messages In This Thread
Re: QLoRA resource reality check with SGLang - by batchpeak - 09-23-2026, 02:56 PM

Forum Jump:


Users browsing this thread: 1 Guest(s)