10-02-2026, 05:59 AM
Good point. The pattern around prefill/decode split has been pretty similar for me. The biggest change for me was simplifying the stack instead of adding one more optimization layer.
small models can still be useful