Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
prompt length getting silly
#3
Thanks, that helps. The pattern around tail latency has been pretty similar for me. Worth rechecking your defaults though, because one bad assumption can make the rest of the thread look confusing.
serving stack tinkerer
Reply


Messages In This Thread
prompt length getting silly - by fusedhall56 - 10-18-2026, 03:47 AM
Re: prompt length getting silly - by torchshed66 - 10-18-2026, 05:24 AM
Re: prompt length getting silly - by audioforge - 10-18-2026, 04:48 PM
Re: prompt length getting silly - by paperport64 - 10-19-2026, 01:12 AM
Re: prompt length getting silly - by nanopatch - 10-19-2026, 03:05 AM
Re: prompt length getting silly - by localpatch - 10-19-2026, 03:59 AM

Forum Jump:


Users browsing this thread: 1 Guest(s)