+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Harnesses, Agents & Orchestration (https://www.datasculpting.ai/inference/forumdisplay.php?fid=11)
+--- Forum: Workflows / Automation (https://www.datasculpting.ai/inference/forumdisplay.php?fid=47)
+--- Thread: frontier API value lately (/showthread.php?tid=87)
Pages:
1
2
Re: frontier API value lately - tensorriver - 09-11-2026
What worked for me was pretty simple. Start by verifying the driver/runtime combo, then test with a smaller prompt, then look at NVFP4.
Re: frontier API value lately - routecraft - 09-12-2026
Interesting, I hadn't tried that. I ended up in about the same place using SGLang. Worth rechecking your defaults though, because one bad assumption can make the rest of the thread look confusing.
Re: frontier API value lately - flintriver50 - 09-13-2026
I tested this tonight. I couldn't reproduce the slowdown until I pushed context much higher.