speculative decoding in llama.cpp with SGLang

[macroforge]

Interesting, I hadn't tried that. That matches what I saw on 4090. Worth rechecking your defaults though, because one bad assumption can make the rest of the thread look confusing.

There are a few different conversations hiding inside this thread, so being explicit about the goal helps. I keep promising myself this is the last rebuild.