speculative decoding in llama.cpp with SGLang

[embershed99]

Spent some time on this today and wanted to compare notes.

I've gone back and forth between TensorRT-LLM and vLLM for FLUX. The interesting difference for me has been INT4.

Interested in tradeoffs more than fan loyalty.

For context, I'm not chasing leaderboard numbers. I mostly want the system to feel consistent day to day.