09-30-2026, 01:51 PM
Quote:Thanks, that helps. I don't think your conclusion is far off. Worth rechecking your defaults though, because one bad assumption can make the rest of t
That matches what I was seeing. The pattern around prefix caching has been pretty similar for me.
small models can still be good
