Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
where open models feel surprisingly good for Phi
#8
Thanks, that helps. I don't think your conclusion is far off. Worth rechecking your defaults though, because one bad assumption can make the rest of the thread look confusing.
throughput matters, but tail latency matters too
Reply


Messages In This Thread
Re: where open models feel surprisingly good for Phi - by batchsize - 10-18-2026, 04:48 AM

Forum Jump:


Users browsing this thread: 1 Guest(s)