+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Generative AI (https://www.datasculpting.ai/inference/forumdisplay.php?fid=17)
+--- Forum: Audio / Speech (https://www.datasculpting.ai/inference/forumdisplay.php?fid=71)
+--- Thread: Audio / Speech discussion (/showthread.php?tid=525)
Pages:
1
2
Audio / Speech discussion - ggufvault - 09-28-2026
Posting this in case it saves someone else a little time.
If you were starting from scratch today for this use case, what would you choose first and what would you ignore?
I'm especially interested in mistakes worth avoiding.
For context, I'm not chasing leaderboard numbers. I mostly want the system to feel consistent day to day.
Re: Audio / Speech discussion - flintriver50 - 09-28-2026
That matches what I was seeing. That matches what I saw on 7900 XTX.
Re: Audio / Speech discussion - tensorfield88 - 09-29-2026
Quote:That matches what I was seeing. That matches what I saw on 7900 XTX.
Ran a quick check on my box. My result was mixed: first run looked bad, second run looked normal.
Re: Audio / Speech discussion - vramforge - 09-29-2026
Quote:Quote:That matches what I was seeing. That matches what I saw on 7900 XTX.
Interesting, I hadn't tried that. I ended up in about the same place using SGLang. The biggest change for me was simplifying the stack instead of adding one more optimization layer.
I'm happy to test one more variant if you want a second data point.
Re: Audio / Speech discussion - signalpeak - 10-02-2026
Quote:Quote:Quote:That matches what I was seeing. That matches what I saw on 7900 XTX.
that fixed it for me too.
Re: Audio / Speech discussion - cudapoint - 10-04-2026
Quote:Quote:Quote:Quote:That matches what I was seeing. That matches what I saw on 7900 XTX.
Can you fill in a bit more context? Are you testing this on B200 or something else?
Re: Audio / Speech discussion - relayforge - 10-05-2026
I tested this tonight. I couldn't reproduce the slowdown until I pushed context much higher.
Re: Audio / Speech discussion - kernelhouse70 - 10-05-2026
A couple questions before I guess too hard. What model, what runtime, and roughly what context size?
Re: Audio / Speech discussion - signalcraft14 - 10-05-2026
A couple questions before I guess too hard. Are you testing this on A6000 or something else?
Re: Audio / Speech discussion - flintriver50 - 10-05-2026
I don't think that's the whole story. The reported numbers can look compelling, but in ordinary usage I didn't see the same benefit.