speculative decoding actually worth it on dual 3090

[cacheline]

Good point. The pattern around NVFP4 has been pretty similar for me. The biggest change for me was simplifying the stack instead of adding one more op

What worked for me was pretty simple. On dual 3090, the easiest win is often to back off the aggressive settings and see whether the problem survives. Not glamorous advice, but repeatable baselines save a lot of time.