09-24-2026, 05:58 AM
Spent some time on this today and wanted to compare notes.
Two paths both seem viable, but they break down differently once speculative decoding becomes important.
Interested in tradeoffs more than fan loyalty.
Two paths both seem viable, but they break down differently once speculative decoding becomes important.
Interested in tradeoffs more than fan loyalty.
small models can still be useful