+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Generative AI (https://www.datasculpting.ai/inference/forumdisplay.php?fid=17)
+--- Forum: Audio / Speech (https://www.datasculpting.ai/inference/forumdisplay.php?fid=71)
+--- Thread: Help with Audio / Speech: setup advice (/showthread.php?tid=1334)
Pages:
1
2
Help with Audio / Speech: setup advice - llmarch83 - 10-16-2026
Posting this in case it saves someone else a little time.
I'm helping a small team set up a local workflow. We don't need a giant stack, but we do care about reranking.
Simple and boring is a valid answer.
Re: Help with Audio / Speech: setup advice - sanescope - 10-16-2026
A couple things I'd check first. Before rebuilding anything, I'd test one clean baseline with DeepSeek and compare from there. Once you know the plain path works, then add the faster path back in piece by piece.
Re: Help with Audio / Speech: setup advice - signalpeak - 10-18-2026
A couple questions before I guess too hard. Is this local-only or are you routing anything externally?
Re: Help with Audio / Speech: setup advice - vramforge - 10-18-2026
Quote:A couple questions before I guess too hard. Is this local-only or are you routing anything externally?
same here on my side.
Re: Help with Audio / Speech: setup advice - vectorfield - 10-18-2026
My first guess would be this: On 5090, the easiest win is often to back off the aggressive settings and see whether the problem survives. Once you know the plain path works, then add the faster path back in piece by piece.
Re: Help with Audio / Speech: setup advice - signalcraft14 - 10-18-2026
Thanks, that helps. The pattern around batch size has been pretty similar for me. I got better results once I stopped chasing one metric and just looked at whether the workflow felt usable.
Re: Help with Audio / Speech: setup advice - cozywire - 10-18-2026
A couple things I'd check first. Before rebuilding anything, I'd test one clean baseline with Kimi and compare from there.
Re: Help with Audio / Speech: setup advice - prompttinker44 - 10-19-2026
My first guess would be this: If you're on Ollama, I'd confirm the version first and then reduce variables until the behavior is obvious. A lot of these threads end up being one bad config plus a pile of conclusions drawn from it.
Re: Help with Audio / Speech: setup advice - sparrowhall - 10-19-2026
I tested this tonight. I couldn't reproduce the slowdown until I pushed context much higher.
Re: Help with Audio / Speech: setup advice - signalpeak - 10-19-2026
Quote:A couple things I'd check first. Before rebuilding anything, I'd test one clean baseline with Kimi and compare from there.
Tried to reproduce it just now. The issue went away once I changed one setting and restarted the stack cleanly. I expected the model choice to matter more than it did.
If you post your exact settings, people here can probably narrow it down pretty fast.