10-14-2026, 02:37 AM
Wanted to compare notes with people doing similar things.
I'm mostly working with Kimi in TensorRT-LLM on M3 Max. The part I'm trying to understand is speculative decoding.
If you've tested something similar, what did you keep and what did you stop bothering with?
I'm mostly working with Kimi in TensorRT-LLM on M3 Max. The part I'm trying to understand is speculative decoding.
If you've tested something similar, what did you keep and what did you stop bothering with?
watching release notes so you don't have to