09-24-2026, 03:31 AM
Not sure I agree there. I've seen people blame prefill/decode split when the real issue was much more mundane. Could be a workload difference, but I wouldn't generalize too fast from one setup.
small models can still be good
