![]() |
|
model merge got better or just different for Kimi - Printable Version +- Inference (https://www.datasculpting.ai/inference) +-- Forum: Harnesses, Agents & Orchestration (https://www.datasculpting.ai/inference/forumdisplay.php?fid=11) +--- Forum: MCP / APIs / Tool Calling (https://www.datasculpting.ai/inference/forumdisplay.php?fid=46) +--- Thread: model merge got better or just different for Kimi (/showthread.php?tid=418) |
model merge got better or just different for Kimi - audiopoint18 - 09-22-2026 Spent some time on this today and wanted to compare notes. Two paths both seem viable, but they break down differently once workstation thermals becomes important. What would you pick if you had to live with it for a few months? Re: model merge got better or just different for Kimi - labline - 09-22-2026 Good point. The pattern around prefill/decode split has been pretty similar for me. I got better results once I stopped chasing one metric and just looked at whether the workflow felt usable. Re: model merge got better or just different for Kimi - nanopatch - 09-25-2026 Did a small comparison this afternoon. On 4090 with TensorRT-LLM, I saw basically the same behavior. |