speculative decoding in llama.cpp

[dockridge]

My first guess would be this: On Threadripper box, the easiest win is often to back off the aggressive settings and see whether the problem survives.