+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Prompting & Context Engineering (https://www.datasculpting.ai/inference/forumdisplay.php?fid=15)
+--- Forum: Structured Output (https://www.datasculpting.ai/inference/forumdisplay.php?fid=63)
+--- Thread: how strict do you make schemas (/showthread.php?tid=317)
Pages:
1
2
how strict do you make schemas - northcraft90 - 09-16-2026
This keeps coming up in conversation so I figured I'd start a thread.
The more I work with local setups, the more it seems like structured output decides everything downstream.
Wondering if this is just where the whole space is heading now.
Re: how strict do you make schemas - signalcraft14 - 09-16-2026
Quote:This keeps coming up in conversation so I figured I'd start a thread.
Tried to reproduce it just now. On GB200 with llama.cpp, I saw basically the same behavior. The surprise was that memory pressure showed up before throughput collapsed.
Re: how strict do you make schemas - audioforge - 09-18-2026
A couple things I'd check first. On 5090, the easiest win is often to back off the aggressive settings and see whether the problem survives. A lot of these threads end up being one bad config plus a pile of conclusions drawn from it.
Re: how strict do you make schemas - llmarch51 - 09-19-2026
Tried to reproduce it just now. The issue went away once I changed one setting and restarted the stack cleanly.
Re: how strict do you make schemas - fusedhall - 09-20-2026
Interesting, I hadn't tried that. I don't think your conclusion is far off. I got better results once I stopped chasing one metric and just looked at whether the workflow felt usable.
Re: how strict do you make schemas - llmtrack26 - 09-21-2026
I'd start with the simpler stack.
Re: how strict do you make schemas - torchdesk - 09-22-2026
same here on my side.
Re: how strict do you make schemas - kernelhouse70 - 09-22-2026
Good point. I don't think your conclusion is far off. I got better results once I stopped chasing one metric and just looked at whether the workflow felt usable.
Re: how strict do you make schemas - mintforge - 09-22-2026
Quote:Good point. I don't think your conclusion is far off. I got better results once I stopped chasing one metric and just looked at whether the workflow f
same here on my side.
Re: how strict do you make schemas - cacheline - 09-23-2026
Can you fill in a bit more context? Are you testing this on B200 or something else?