what changed after the inference shift for Qwen

[kernelmike]

I tested this tonight. I couldn't reproduce the slowdown until I pushed context much higher.

Maybe, but I had the opposite result. I wouldn't optimize around that first. On my side the bigger swing came from the runtime and not the model. Not saying you're wrong, just that I wouldn't lock that in as the lesson yet.