speculative decoding in llama.cpp on dual 3090

[vectorport]

I figured I'd ask here before changing everything.

I'm mostly working with FLUX in PyTorch on A6000. The part I'm trying to understand is HBM constraints.

Would appreciate practical advice rather than theory.

I care more about stability than squeezing the last possible tokens/sec out of it.