09-22-2026, 10:29 PM
Good point. The pattern around prefill/decode split has been pretty similar for me. I got better results once I stopped chasing one metric and just looked at whether the workflow felt usable.
still benchmarking everything