09-27-2026, 02:03 PM
I don't think that's the whole story. I've seen people blame KV cache pressure when the real issue was much more mundane. Worth testing the simpler explanation before adopting the more interesting one.
small models can still be good
