small speech stack for local use: setup advice

[cobaltspark]

Interesting, I hadn't tried that. The pattern around speculative decoding has been pretty similar for me. Worth rechecking your defaults though, because one bad assumption can make the rest of the thread look confusing.