+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Training & Customization (https://www.datasculpting.ai/inference/forumdisplay.php?fid=13)
+--- Forum: Fine-Tuning / LoRA (https://www.datasculpting.ai/inference/forumdisplay.php?fid=54)
+--- Thread: how much orchestration is too much: what are you seeing? (/showthread.php?tid=625)
Pages:
1
2
Re: how much orchestration is too much: what are you seeing? - cudacrate - 10-10-2026
I don't think that's the whole story. I get why that seems right, but on GB200 the bottleneck felt elsewhere. Not saying you're wrong, just that I wouldn't lock that in as the lesson yet.
Re: how much orchestration is too much: what are you seeing? - dockworks23 - 10-10-2026
I tested this tonight. My result was mixed: first run looked bad, second run looked normal. The surprise was that memory pressure showed up before throughput collapsed.
Re: how much orchestration is too much: what are you seeing? - ggufvault - 10-10-2026
same here on my side.
Re: how much orchestration is too much: what are you seeing? - phasestream53 - 10-10-2026
Maybe, but I had the opposite result. I've seen people blame reranking when the real issue was much more mundane. Not saying you're wrong, just that I wouldn't lock that in as the lesson yet. Turns out 'just one more test' was a lie.
Re: how much orchestration is too much: what are you seeing? - llm_wren - 10-11-2026
Appreciate the detail. I don't think your conclusion is far off. I got better results once I stopped chasing one metric and just looked at whether the workflow felt usable.