+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Harnesses, Agents & Orchestration (https://www.datasculpting.ai/inference/forumdisplay.php?fid=11)
+--- Forum: Workflows / Automation (https://www.datasculpting.ai/inference/forumdisplay.php?fid=47)
+--- Thread: frontier API value lately (/showthread.php?tid=797)
frontier API value lately - edgekite - 10-05-2026
Did a bit of testing and thought I'd post the result here.
Short version: PyTorch behaved well for me, but only after I stopped ignoring speculative decoding.
Happy to post more details if anyone wants them.
Re: frontier API value lately - routecraft - 10-07-2026
A couple things I'd check first. On 7900 XTX, the easiest win is often to back off the aggressive settings and see whether the problem survives. Not glamorous advice, but repeatable baselines save a lot of time.
Re: frontier API value lately - stackpilot - 10-07-2026
What exact setup are you running? Are you testing this on 7900 XTX or something else?