10-02-2026, 02:38 AM
Spent some time on this today and wanted to compare notes.
Two paths both seem viable, but they break down differently once prefill/decode split becomes important.
Interested in tradeoffs more than fan loyalty.
My use case is pretty ordinary: local chat, some document work, and occasional batch jobs.
Two paths both seem viable, but they break down differently once prefill/decode split becomes important.
Interested in tradeoffs more than fan loyalty.
My use case is pretty ordinary: local chat, some document work, and occasional batch jobs.