09-02-2026, 12:36 AM
Spent some time on this today and wanted to compare notes.
Two paths both seem viable, but they break down differently once speculative decoding becomes important.
Trying to avoid rebuilding the whole thing twice.
This is mostly for local work rather than public serving.
Two paths both seem viable, but they break down differently once speculative decoding becomes important.
Trying to avoid rebuilding the whole thing twice.
This is mostly for local work rather than public serving.