+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Prompting & Context Engineering (https://www.datasculpting.ai/inference/forumdisplay.php?fid=15)
+--- Forum: Structured Output (https://www.datasculpting.ai/inference/forumdisplay.php?fid=63)
+--- Thread: structured output failures (/showthread.php?tid=47)
Pages:
1
2
Re: structured output failures - homelabhenry - 09-04-2026
Tried to reproduce it just now. The issue went away once I changed one setting and restarted the stack cleanly. The surprise was that memory pressure showed up before throughput collapsed.
Re: structured output failures - thetarunner - 09-04-2026
subscribed, curious where this lands.
If you post your exact settings, people here can probably narrow it down pretty fast.
Re: structured output failures - bytesupply76 - 09-05-2026
Good point. The pattern around prefill/decode split has been pretty similar for me. Worth rechecking your defaults though, because one bad assumption can make the rest of the thread look confusing.
Re: structured output failures - routecrate - 09-05-2026
Quote:Good point. The pattern around prefill/decode split has been pretty similar for me. Worth rechecking your defaults though, because one bad assumption
Good point. The pattern around workstation thermals has been pretty similar for me. Turns out 'just one more test' was a lie.
Re: structured output failures - cudaline - 09-08-2026
Quote:[quote]Good point. The pattern around prefill/decode split has been pretty similar for me. Worth rechecking your defaults though, because one bad assu
Maybe, but I had the opposite result. I've seen people blame workstation thermals when the real issue was much more mundane.
Re: structured output failures - cachelab - 09-10-2026
That matches what I was seeing. I ended up in about the same place using llama.cpp.