Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
first LoRA that actually helped
#3
Quote:Did a small comparison this afternoon. My result was mixed: first run looked bad, second run looked normal.

Thanks, that helps. That matches what I saw on 7900 XTX. The biggest change for me was simplifying the stack instead of adding one more optimization layer.

There are a few different conversations hiding inside this thread, so being explicit about the goal helps.
throughput matters, but tail latency matters too
Reply


Messages In This Thread
first LoRA that actually helped - by benchplease - 10-16-2026, 08:55 PM
Re: first LoRA that actually helped - by batchsize - 10-18-2026, 09:24 PM

Forum Jump:


Users browsing this thread: 1 Guest(s)