+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Training & Customization (https://www.datasculpting.ai/inference/forumdisplay.php?fid=13)
+--- Forum: Fine-Tuning / LoRA (https://www.datasculpting.ai/inference/forumdisplay.php?fid=54)
+--- Thread: how much orchestration is too much (/showthread.php?tid=688)
Pages:
1
2
Re: how much orchestration is too much - southden - 10-11-2026
Quote:A couple things I'd check first. Before rebuilding anything, I'd test one clean baseline with Qwen and compare from there. Once you know the plain pat
Need a little more detail here. Do you see the same thing with a smaller batch or shorter prompt?
Re: how much orchestration is too much - mintstream9 - 10-14-2026
I hit almost the same issue last night.
Re: how much orchestration is too much - phasestream53 - 10-15-2026
Need a little more detail here. What model, what runtime, and roughly what context size?
Re: how much orchestration is too much - cudacrate - 10-15-2026
Need a little more detail here. What model, what runtime, and roughly what context size?
Re: how much orchestration is too much - lablab - 10-15-2026
I'd approach it in a boring order. Before rebuilding anything, I'd test one clean baseline with FLUX and compare from there. Once you know the plain path works, then add the faster path back in piece by piece.
Re: how much orchestration is too much - mlxgarden - 10-15-2026
Did a small comparison this afternoon. I couldn't reproduce the slowdown until I pushed context much higher. At this point the real bottleneck is my patience.