speculative decoding actually worth it

[torchsmith25]

I'm trying to sanity-check my setup.

What worked for me was pretty simple. Start by verifying the driver/runtime combo, then test with a smaller prompt, then look at HBM constraints. At this point the real bottleneck is my patience.