09-24-2026, 10:21 AM
Quote:Can you fill in a bit more context? Do you see the same thing with a smaller batch or shorter prompt?
Good point. The pattern around prefill/decode split has been pretty similar for me. The biggest change for me was simplifying the stack instead of adding one more optimization layer.
7900 XTX / ROCm / somehow still optimistic
