+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Generative AI (https://www.datasculpting.ai/inference/forumdisplay.php?fid=17)
+--- Forum: Audio / Speech (https://www.datasculpting.ai/inference/forumdisplay.php?fid=71)
+--- Thread: Help with Audio / Speech with Ollama (/showthread.php?tid=568)
Pages:
1
2
Help with Audio / Speech with Ollama - cacheworks - 09-28-2026
Posting this in case it saves someone else a little time.
I'm not trying to build a perfect architecture diagram. I just want a sane starting point around SGLang and A6000.
Would rather learn from your scars than collect my own all at once.
My use case is pretty ordinary: local chat, some document work, and occasional batch jobs.
Re: Help with Audio / Speech with Ollama - sparrowkite53 - 09-28-2026
Need a little more detail here. Are you testing this on Threadripper box or something else?
Re: Help with Audio / Speech with Ollama - cozywire - 09-29-2026
Quote:Need a little more detail here. Are you testing this on Threadripper box or something else?
Appreciate the detail. The pattern around small local stacks has been pretty similar for me.
Re: Help with Audio / Speech with Ollama - sparrowhall - 09-30-2026
Quote:Quote:Need a little more detail here. Are you testing this on Threadripper box or something else?
A couple things I'd check first. On mini PC, the easiest win is often to back off the aggressive settings and see whether the problem survives.
Re: Help with Audio / Speech with Ollama - vectorfield - 09-30-2026
Thanks, that helps. That matches what I saw on dual 3090. I got better results once I stopped chasing one metric and just looked at whether the workflow felt usable.
Re: Help with Audio / Speech with Ollama - vramridge - 09-30-2026
worth checking the driver first.
Re: Help with Audio / Speech with Ollama - audiopoint18 - 09-30-2026
subscribed, curious where this lands.
Re: Help with Audio / Speech with Ollama - cudapoint - 09-30-2026
I don't think that's the whole story. The reported numbers can look compelling, but in ordinary usage I didn't see the same benefit. Worth testing the simpler explanation before adopting the more interesting one.
Re: Help with Audio / Speech with Ollama - vramport - 10-01-2026
My first guess would be this: Before rebuilding anything, I'd test one clean baseline with Mixtral and compare from there. Once you know the plain path works, then add the faster path back in piece by piece.
Re: Help with Audio / Speech with Ollama - signalpeak - 10-04-2026
My first guess would be this: Before rebuilding anything, I'd test one clean baseline with Mistral and compare from there. A lot of these threads end up being one bad config plus a pile of conclusions drawn from it.
I'm happy to test one more variant if you want a second data point.