09-17-2026, 11:13 PM
This keeps coming up in conversation so I figured I'd start a thread.
The more I work with local setups, the more it seems like prefill/decode split decides everything downstream.
Wondering if this is just where the whole space is heading now.
The part that surprised me was how much the boring details mattered more than the model choice.
The more I work with local setups, the more it seems like prefill/decode split decides everything downstream.
Wondering if this is just where the whole space is heading now.
The part that surprised me was how much the boring details mattered more than the model choice.
Apple Silicon • MLX mostly