+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Harnesses, Agents & Orchestration (https://www.datasculpting.ai/inference/forumdisplay.php?fid=11)
+--- Forum: MCP / APIs / Tool Calling (https://www.datasculpting.ai/inference/forumdisplay.php?fid=46)
+--- Thread: model merge got better or just different: anyone testing this? (/showthread.php?tid=251)
model merge got better or just different: anyone testing this? - relayforge - 09-12-2026
Maybe I'm missing something obvious.
My current setup is PyTorch with A6000, and I keep running into prefill/decode split.
Would appreciate practical advice rather than theory.
Re: model merge got better or just different: anyone testing this? - phasespark - 09-13-2026
Good point. I ended up in about the same place using Ollama. I got better results once I stopped chasing one metric and just looked at whether the workflow felt usable.
Re: model merge got better or just different: anyone testing this? - vramforge - 09-14-2026
A couple things I'd check first. Before rebuilding anything, I'd test one clean baseline with Mistral and compare from there. Once you know the plain path works, then add the faster path back in piece by piece.
If you post your exact settings, people here can probably narrow it down pretty fast.