10-11-2026, 07:42 PM
I think the bottleneck is somewhere else. I've seen people blame speculative decoding when the real issue was much more mundane. Not saying you're wrong, just that I wouldn't lock that in as the lesson yet.
Mostly CUDA, sometimes wrong, usually measured