10-03-2026, 09:13 AM
This keeps coming up in conversation so I figured I'd start a thread.
One thing I keep noticing is that people underestimate prefill/decode split until they actually try to run this stuff for more than one afternoon.
Wondering if this is just where the whole space is heading now.
One thing I keep noticing is that people underestimate prefill/decode split until they actually try to run this stuff for more than one afternoon.
Wondering if this is just where the whole space is heading now.