speculative decoding in llama.cpp: anyone testing this?

[mellowwire98]

Spent some time on this today and wanted to compare notes.

I've gone back and forth between MLX and MLX for Gemma. The interesting difference for me has been prefill/decode split.

Trying to avoid rebuilding the whole thing twice.