09-23-2026, 04:42 PM
This keeps coming up in conversation so I figured I'd start a thread.
The more I work with local setups, the more it seems like prefill/decode split decides everything downstream.
Curious whether that lines up with what other people are seeing.
The more I work with local setups, the more it seems like prefill/decode split decides everything downstream.
Curious whether that lines up with what other people are seeing.