do small edge boxes make sense with llama.cpp

[cobaltworks25]

That matches what I was seeing. The pattern around prefill/decode split has been pretty similar for me. Worth rechecking your defaults though, because one bad assumption can make the rest of the thread look confusing.