speculative decoding in llama.cpp

[mangotinker73]

Did a small comparison this afternoon. On M3 Max with MLX, I saw basically the same behavior. The main thing that moved was latency, not quality.

There are a few different conversations hiding inside this thread, so being explicit about the goal helps.