+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Harnesses, Agents & Orchestration (https://www.datasculpting.ai/inference/forumdisplay.php?fid=11)
+--- Forum: Routers (https://www.datasculpting.ai/inference/forumdisplay.php?fid=45)
+--- Thread: synthetic data for support bots for Qwen (/showthread.php?tid=1154)
synthetic data for support bots for Qwen - emberquill - 10-13-2026
Wanted to compare notes with people doing similar things.
I'm mostly working with Kimi in Ollama on B200. The part I'm trying to understand is structured output.
Not looking for the perfect answer, mostly what worked in real use.
Re: synthetic data for support bots for Qwen - promptpoint - 10-13-2026
Can you fill in a bit more context? Is this local-only or are you routing anything externally? I keep promising myself this is the last rebuild.
Re: synthetic data for support bots for Qwen - vramforge - 10-13-2026
Quote:Can you fill in a bit more context? Is this local-only or are you routing anything externally? I keep promising myself this is the last rebuild.
What exact setup are you running? Do you see the same thing with a smaller batch or shorter prompt?
Re: synthetic data for support bots for Qwen - routeline23 - 10-16-2026
A couple questions before I guess too hard. Do you see the same thing with a smaller batch or shorter prompt?
Re: synthetic data for support bots for Qwen - audioforge - 10-16-2026
Quote:A couple questions before I guess too hard. Do you see the same thing with a smaller batch or shorter prompt?
I think the bottleneck is somewhere else. I wouldn't optimize around that first. On my side the bigger swing came from the runtime and not the model. Worth testing the simpler explanation before adopting the more interesting one.
There are a few different conversations hiding inside this thread, so being explicit about the goal helps.
Re: synthetic data for support bots for Qwen - plainworks - 10-16-2026
What exact setup are you running? Are you testing this on mini PC or something else?
Re: synthetic data for support bots for Qwen - dockworks23 - 10-16-2026
I hit almost the same issue last night.
Re: synthetic data for support bots for Qwen - rocmhouse90 - 10-17-2026
Thanks, that helps. I ended up in about the same place using MLX. The biggest change for me was simplifying the stack instead of adding one more optimization layer.
There are a few different conversations hiding inside this thread, so being explicit about the goal helps.