09-24-2026, 03:56 AM
Quote:Did a bit of testing and thought I'd post the result here.
I don't think that's the whole story. I've seen people blame KV cache pressure when the real issue was much more mundane. Could be a workload difference, but I wouldn't generalize too fast from one setup.
