+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Harnesses, Agents & Orchestration (https://www.datasculpting.ai/inference/forumdisplay.php?fid=11)
+--- Forum: Routers (https://www.datasculpting.ai/inference/forumdisplay.php?fid=45)
+--- Thread: dataset format recommendations: anyone testing this? (/showthread.php?tid=963)
Pages:
1
2
dataset format recommendations: anyone testing this? - plainline - 10-09-2026
Spent some time on this today and wanted to compare notes.
I'm comparing two approaches here: keep it simple on 5090, or squeeze more out of the stack and deal with the complexity.
What would you pick if you had to live with it for a few months?
Re: dataset format recommendations: anyone testing this? - audiorunner74 - 10-11-2026
My first guess would be this: Before rebuilding anything, I'd test one clean baseline with DeepSeek and compare from there. Once you know the plain path works, then add the faster path back in piece by piece.
Re: dataset format recommendations: anyone testing this? - quantsupply - 10-14-2026
A couple things I'd check first. Start by verifying the driver/runtime combo, then test with a smaller prompt, then look at structured output.
Re: dataset format recommendations: anyone testing this? - forgemixer - 10-14-2026
Quote:A couple things I'd check first. Start by verifying the driver/runtime combo, then test with a smaller prompt, then look at structured output.
worth checking the driver first.
Re: dataset format recommendations: anyone testing this? - routecraft - 10-15-2026
What worked for me was pretty simple. Start by verifying the driver/runtime combo, then test with a smaller prompt, then look at workstation thermals. Not glamorous advice, but repeatable baselines save a lot of time.
Re: dataset format recommendations: anyone testing this? - plainworks - 10-15-2026
I'd start with the simpler stack.
Re: dataset format recommendations: anyone testing this? - quantsupply - 10-15-2026
Did a small comparison this afternoon. The issue went away once I changed one setting and restarted the stack cleanly.
Re: dataset format recommendations: anyone testing this? - phasenode - 10-15-2026
worth checking the driver first.
Re: dataset format recommendations: anyone testing this? - macroforge - 10-16-2026
I'd start with the simpler stack.
I'm happy to test one more variant if you want a second data point.
Re: dataset format recommendations: anyone testing this? - routecraft - 10-17-2026
Not sure I agree there. I get why that seems right, but on GB200 the bottleneck felt elsewhere. Could be a workload difference, but I wouldn't generalize too fast from one setup.