Inference
how strict do you make schemas - Printable Version

+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Prompting & Context Engineering (https://www.datasculpting.ai/inference/forumdisplay.php?fid=15)
+--- Forum: Structured Output (https://www.datasculpting.ai/inference/forumdisplay.php?fid=63)
+--- Thread: how strict do you make schemas (/showthread.php?tid=751)



how strict do you make schemas - paperrunner - 10-04-2026

Curious what people here are seeing.

My current setup is vLLM with 5090, and I keep running into embeddings.

If you've tested something similar, what did you keep and what did you stop bothering with?