routing between local and hosted for Kimi

[rocmmixer]

That matches what I was seeing. I don't think your conclusion is far off. The biggest change for me was simplifying the stack instead of adding one more optimization layer.

[lablab]

worth checking the driver first.

[batchcraft]

Need a little more detail here. What model, what runtime, and roughly what context size?