09-28-2026, 05:17 PM
This keeps coming up in conversation so I figured I'd start a thread.
The more I work with local setups, the more it seems like speculative decoding decides everything downstream.
Wondering if this is just where the whole space is heading now.
The more I work with local setups, the more it seems like speculative decoding decides everything downstream.
Wondering if this is just where the whole space is heading now.
Apple Silicon • MLX mostly