+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Prompting & Context Engineering (https://www.datasculpting.ai/inference/forumdisplay.php?fid=15)
+--- Forum: Structured Output (https://www.datasculpting.ai/inference/forumdisplay.php?fid=63)
+--- Thread: structured output failures (/showthread.php?tid=1208)
Pages:
1
2
Re: structured output failures - amberpatch25 - 10-18-2026
Thanks, that helps. The pattern around prefix caching has been pretty similar for me. Worth rechecking your defaults though, because one bad assumption can make the rest of the thread look confusing.
Re: structured output failures - circuitwire58 - 10-19-2026
worth checking the driver first.
Re: structured output failures - thetaplane - 10-19-2026
Quote:Thanks, that helps. The pattern around prefix caching has been pretty similar for me. Worth rechecking your defaults though, because one bad assumptio
That matches what I was seeing. I don't think your conclusion is far off. Worth rechecking your defaults though, because one bad assumption can make the rest of the thread look confusing.
Re: structured output failures - latentpeak22 - 10-19-2026
That matches what I was seeing. I ended up in about the same place using SGLang.