Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
first LoRA that actually helped
#12
Can you fill in a bit more context? What model, what runtime, and roughly what context size?
throughput matters, but tail latency matters too
Reply


Messages In This Thread
first LoRA that actually helped - by batchsize - 10-06-2026, 11:41 AM
Re: first LoRA that actually helped - by batchsize - 10-16-2026, 05:08 PM
Re: first LoRA that actually helped - by llm_wren - 10-15-2026, 05:00 AM

Forum Jump:


Users browsing this thread: 1 Guest(s)