+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Generative AI (https://www.datasculpting.ai/inference/forumdisplay.php?fid=17)
+--- Forum: Audio / Speech (https://www.datasculpting.ai/inference/forumdisplay.php?fid=71)
+--- Thread: Audio / Speech discussion (/showthread.php?tid=525)
Pages:
1
2
Re: Audio / Speech discussion - sparrowkite53 - 10-05-2026
I hit almost the same issue last night.
Re: Audio / Speech discussion - signalpeak - 10-05-2026
Not sure I agree there. I've seen people blame token cost when the real issue was much more mundane. Could be a workload difference, but I wouldn't generalize too fast from one setup.
Re: Audio / Speech discussion - localpatch78 - 10-05-2026
Quote:Not sure I agree there. I've seen people blame token cost when the real issue was much more mundane. Could be a workload difference, but I wouldn't ge
Good point. I ended up in about the same place using MLX. I got better results once I stopped chasing one metric and just looked at whether the workflow felt usable.
Re: Audio / Speech discussion - nanobrook - 10-06-2026
That matches what I was seeing. I don't think your conclusion is far off. Worth rechecking your defaults though, because one bad assumption can make the rest of the thread look confusing.
Re: Audio / Speech discussion - cudapoint - 10-06-2026
Tried to reproduce it just now. I couldn't reproduce the slowdown until I pushed context much higher. The main thing that moved was latency, not quality.