Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
structured output failures
#13
Good point. The pattern around prefill/decode split has been pretty similar for me. Worth rechecking your defaults though, because one bad assumption can make the rest of the thread look confusing.
Reply


Messages In This Thread
structured output failures - by cacheline - 08-28-2026, 05:00 AM
Re: structured output failures - by torchshed66 - 08-28-2026, 05:18 PM
Re: structured output failures - by dockkite69 - 08-30-2026, 11:38 PM
Re: structured output failures - by mellowwire98 - 08-31-2026, 12:53 AM
Re: structured output failures - by bytesupply76 - 09-05-2026, 10:03 PM
Re: structured output failures - by dockworks23 - 08-28-2026, 06:24 PM
Re: structured output failures - by vramforge - 08-28-2026, 07:13 PM
Re: structured output failures - by cudaline - 09-08-2026, 10:48 PM
Re: structured output failures - by nanopatch - 08-30-2026, 07:34 AM
Re: structured output failures - by vectorshed43 - 08-30-2026, 10:20 AM
Re: structured output failures - by rocmriley - 08-30-2026, 10:50 PM
Re: structured output failures - by mintstation99 - 09-03-2026, 01:22 AM
Re: structured output failures - by homelabhenry - 09-04-2026, 01:45 PM
Re: structured output failures - by thetarunner - 09-04-2026, 10:00 PM
Re: structured output failures - by routecrate - 09-05-2026, 10:17 PM
Re: structured output failures - by cachelab - 09-10-2026, 11:17 AM

Forum Jump:


Users browsing this thread: 1 Guest(s)