Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
QLoRA resource reality check
#6
Quote:Did a small comparison this afternoon. I couldn't reproduce the slowdown until I pushed context much higher. The surprise was that memory pressure sho

What worked for me was pretty simple. If you're on Ollama, I'd confirm the version first and then reduce variables until the behavior is obvious. A lot of these threads end up being one bad config plus a pile of conclusions drawn from it.
mostly local
Reply


Messages In This Thread
QLoRA resource reality check - by routerunner - 10-18-2026, 03:26 PM
Re: QLoRA resource reality check - by llmtrack26 - 10-18-2026, 04:21 PM
Re: QLoRA resource reality check - by vramarch - 10-19-2026, 01:17 AM
Re: QLoRA resource reality check - by quiethouse - 10-18-2026, 11:57 PM
Re: QLoRA resource reality check - by kernelarch - 10-18-2026, 07:22 PM
Re: QLoRA resource reality check - by quiethouse - 10-18-2026, 08:03 PM
Re: QLoRA resource reality check - by signalpeak - 10-18-2026, 11:17 PM
Re: QLoRA resource reality check - by nanobrook - 10-19-2026, 12:06 AM
Re: QLoRA resource reality check - by batchsize - 10-19-2026, 12:57 AM
Re: QLoRA resource reality check - by cudascope - 10-19-2026, 02:10 AM
Re: QLoRA resource reality check - by quiethouse - 10-19-2026, 04:00 AM
Re: QLoRA resource reality check - by cudascope - 10-19-2026, 05:12 AM

Forum Jump:


Users browsing this thread: 1 Guest(s)