+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Optimization & Performance (https://www.datasculpting.ai/inference/forumdisplay.php?fid=10)
+--- Forum: Context / KV Cache (https://www.datasculpting.ai/inference/forumdisplay.php?fid=41)
+--- Thread: draft model choices for Kimi (/showthread.php?tid=991)
draft model choices for Kimi - cacheline - 10-11-2026
Spent some time on this today and wanted to compare notes.
Two paths both seem viable, but they break down differently once tool calling becomes important.
Trying to avoid rebuilding the whole thing twice.
Re: draft model choices for Kimi - cacheline - 10-12-2026
Can you fill in a bit more context? Is this local-only or are you routing anything externally?