prefill/decode separation in practice

[mangofield33]

Appreciate the detail. That matches what I saw on M3 Max. I got better results once I stopped chasing one metric and just looked at whether the workfl

I'd start with the simpler stack.

There are a few different conversations hiding inside this thread, so being explicit about the goal helps.