10-11-2026, 05:37 PM
I'm trying to sanity-check my setup.
I'm trying to decide whether to keep the current stack or change course. Main question is how people here are handling prefill/decode split.
Not looking for the perfect answer, mostly what worked in real use.
I'm trying to decide whether to keep the current stack or change course. Main question is how people here are handling prefill/decode split.
Not looking for the perfect answer, mostly what worked in real use.
small models can still be useful