10-13-2026, 08:48 PM
This keeps coming up in conversation so I figured I'd start a thread.
The more I work with local setups, the more it seems like MoE serving decides everything downstream.
Curious whether that lines up with what other people are seeing.
The more I work with local setups, the more it seems like MoE serving decides everything downstream.
Curious whether that lines up with what other people are seeing.
Mostly CUDA, sometimes wrong, usually measured