frontier API value lately

[edgekite]

Did a bit of testing and thought I'd post the result here.

Short version: PyTorch behaved well for me, but only after I stopped ignoring speculative decoding.

Happy to post more details if anyone wants them.

[routecraft]

A couple things I'd check first. On 7900 XTX, the easiest win is often to back off the aggressive settings and see whether the problem survives. Not glamorous advice, but repeatable baselines save a lot of time.

[stackpilot]

What exact setup are you running? Are you testing this on 7900 XTX or something else?