speculative decoding actually worth it

[cacheline]

Ran a quick check on my box. My result was mixed: first run looked bad, second run looked normal.

Good point. I don't think your conclusion is far off. Worth rechecking your defaults though, because one bad assumption can make the rest of the thread look confusing.