+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Harnesses, Agents & Orchestration (https://www.datasculpting.ai/inference/forumdisplay.php?fid=11)
+--- Forum: Routers (https://www.datasculpting.ai/inference/forumdisplay.php?fid=45)
+--- Thread: synthetic data for support bots with SGLang (/showthread.php?tid=51)
synthetic data for support bots with SGLang - routecraft - 08-27-2026
Posting this in case it saves someone else a little time.
I'm helping a small team set up a local workflow. We don't need a giant stack, but we do care about continuous batching.
Would rather learn from your scars than collect my own all at once.
I care more about stability than squeezing the last possible tokens/sec out of it.
Re: synthetic data for support bots with SGLang - rocmplane - 08-27-2026
Good point. That matches what I saw on A6000. I got better results once I stopped chasing one metric and just looked at whether the workflow felt usable.
Re: synthetic data for support bots with SGLang - audioforge - 08-27-2026
A couple questions before I guess too hard. Is this local-only or are you routing anything externally?