speculative decoding in llama.cpp: anyone testing this?

[edgequill]

My first guess would be this: Start by verifying the driver/runtime combo, then test with a smaller prompt, then look at workstation thermals.

Ran a quick check on my box. The issue went away once I changed one setting and restarted the stack cleanly. The surprise was that memory pressure showed up before throughput collapsed.