+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: LLM Models (https://www.datasculpting.ai/inference/forumdisplay.php?fid=12)
+--- Forum: Open Weight (https://www.datasculpting.ai/inference/forumdisplay.php?fid=49)
+---- Forum: Recipes & Configurations (https://www.datasculpting.ai/inference/forumdisplay.php?fid=52)
+---- Thread: routing between local and hosted for Kimi (/showthread.php?tid=372)
Pages:
1
2
Re: routing between local and hosted for Kimi - rocmmixer - 09-25-2026
That matches what I was seeing. I don't think your conclusion is far off. The biggest change for me was simplifying the stack instead of adding one more optimization layer.
Re: routing between local and hosted for Kimi - lablab - 09-25-2026
worth checking the driver first.
Re: routing between local and hosted for Kimi - batchcraft - 09-25-2026
Need a little more detail here. What model, what runtime, and roughly what context size?