Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
first LoRA that actually helped
#10
Thanks, that helps. That matches what I saw on B200. Worth rechecking your defaults though, because one bad assumption can make the rest of the thread look confusing.
throughput matters, but tail latency matters too
Reply


Messages In This Thread
first LoRA that actually helped - by cacheline - 08-23-2026, 05:51 AM
Re: first LoRA that actually helped - by batchsize - 08-28-2026, 12:17 AM

Forum Jump:


Users browsing this thread: 1 Guest(s)