+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Prompting & Context Engineering (https://www.datasculpting.ai/inference/forumdisplay.php?fid=15)
+--- Forum: Structured Output (https://www.datasculpting.ai/inference/forumdisplay.php?fid=63)
+--- Thread: JSON mode across models (/showthread.php?tid=800)
JSON mode across models - cachebench - 10-05-2026
This keeps coming up in conversation so I figured I'd start a thread.
One thing I keep noticing is that people underestimate reranking until they actually try to run this stuff for more than one afternoon.
Wondering if this is just where the whole space is heading now.
Re: JSON mode across models - papermixer4 - 10-06-2026
Tried to reproduce it just now. On 4090 with llama.cpp, I saw basically the same behavior.
Re: JSON mode across models - macroforge - 10-06-2026
A couple questions before I guess too hard. Is this local-only or are you routing anything externally?