Audio / Speech discussion

[sparrowkite53]

I hit almost the same issue last night.

[signalpeak]

Not sure I agree there. I've seen people blame token cost when the real issue was much more mundane. Could be a workload difference, but I wouldn't generalize too fast from one setup.

[localpatch78]

Not sure I agree there. I've seen people blame token cost when the real issue was much more mundane. Could be a workload difference, but I wouldn't ge

Good point. I ended up in about the same place using MLX. I got better results once I stopped chasing one metric and just looked at whether the workflow felt usable.

[nanobrook]

That matches what I was seeing. I don't think your conclusion is far off. Worth rechecking your defaults though, because one bad assumption can make the rest of the thread look confusing.

[cudapoint]

Tried to reproduce it just now. I couldn't reproduce the slowdown until I pushed context much higher. The main thing that moved was latency, not quality.