+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Generative AI (https://www.datasculpting.ai/inference/forumdisplay.php?fid=17)
+--- Forum: Audio / Speech (https://www.datasculpting.ai/inference/forumdisplay.php?fid=71)
+--- Thread: Audio / Speech discussion: setup advice (/showthread.php?tid=474)
Audio / Speech discussion: setup advice - amberkite - 09-24-2026
This keeps coming up in conversation so I figured I'd start a thread.
One thing I keep noticing is that people underestimate batch size until they actually try to run this stuff for more than one afternoon.
Maybe obvious to some of you, but it clicked for me this week.
Re: Audio / Speech discussion: setup advice - vramport - 09-24-2026
Quote:This keeps coming up in conversation so I figured I'd start a thread.
A couple things I'd check first. On A6000, the easiest win is often to back off the aggressive settings and see whether the problem survives. A lot of these threads end up being one bad config plus a pile of conclusions drawn from it.
Re: Audio / Speech discussion: setup advice - fastscope - 09-24-2026
Quote:Quote:This keeps coming up in conversation so I figured I'd start a thread.
My first guess would be this: If you're on TensorRT-LLM, I'd confirm the version first and then reduce variables until the behavior is obvious. A lot of these threads end up being one bad config plus a pile of conclusions drawn from it.
If you post your exact settings, people here can probably narrow it down pretty fast.
Re: Audio / Speech discussion: setup advice - vectorfield - 09-27-2026
I don't think that's the whole story. I've seen people blame embeddings when the real issue was much more mundane. Could be a workload difference, but I wouldn't generalize too fast from one setup. The logs were somehow calmer than I was.
Re: Audio / Speech discussion: setup advice - signalcraft14 - 09-27-2026
I'd approach it in a boring order. On mini PC, the easiest win is often to back off the aggressive settings and see whether the problem survives. Not glamorous advice, but repeatable baselines save a lot of time. Turns out 'just one more test' was a lie.
Re: Audio / Speech discussion: setup advice - flintriver50 - 09-27-2026
Tried to reproduce it just now. My result was mixed: first run looked bad, second run looked normal.
Re: Audio / Speech discussion: setup advice - vectorfield - 09-27-2026
A couple things I'd check first. Before rebuilding anything, I'd test one clean baseline with DeepSeek and compare from there. Once you know the plain path works, then add the faster path back in piece by piece.
Re: Audio / Speech discussion: setup advice - kernelhouse70 - 09-27-2026
Did a small comparison this afternoon. I couldn't reproduce the slowdown until I pushed context much higher. The main thing that moved was latency, not quality.
Re: Audio / Speech discussion: setup advice - sparrowgrid - 09-28-2026
Good point. That matches what I saw on 5090. The biggest change for me was simplifying the stack instead of adding one more optimization layer.