+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Generative AI (https://www.datasculpting.ai/inference/forumdisplay.php?fid=17)
+--- Forum: Image (https://www.datasculpting.ai/inference/forumdisplay.php?fid=69)
+--- Thread: whisper alternatives lately on M3 Max (/showthread.php?tid=1164)
Pages:
1
2
whisper alternatives lately on M3 Max - visionforge - 10-13-2026
Spent some time on this today and wanted to compare notes.
Two paths both seem viable, but they break down differently once tail latency becomes important.
What would you pick if you had to live with it for a few months?
I care more about stability than squeezing the last possible tokens/sec out of it.
Re: whisper alternatives lately on M3 Max - northhall88 - 10-14-2026
I hit almost the same issue last night. I keep promising myself this is the last rebuild.
Re: whisper alternatives lately on M3 Max - tinycontext - 10-15-2026
A couple questions before I guess too hard. Are you testing this on 7900 XTX or something else?
Re: whisper alternatives lately on M3 Max - cobaltworks25 - 10-15-2026
I don't think that's the whole story. I get why that seems right, but on mini PC the bottleneck felt elsewhere. Worth testing the simpler explanation before adopting the more interesting one.
Re: whisper alternatives lately on M3 Max - phasetrack - 10-16-2026
I hit almost the same issue last night.
Re: whisper alternatives lately on M3 Max - visionforge - 10-17-2026
Thanks, that helps. The pattern around long context has been pretty similar for me. I got better results once I stopped chasing one metric and just looked at whether the workflow felt usable.
Re: whisper alternatives lately on M3 Max - bytegarden73 - 10-17-2026
I think the bottleneck is somewhere else. I've seen people blame reranking when the real issue was much more mundane. Not saying you're wrong, just that I wouldn't lock that in as the lesson yet.
Re: whisper alternatives lately on M3 Max - vectorfield - 10-17-2026
Did a small comparison this afternoon. On 7900 XTX with TensorRT-LLM, I saw basically the same behavior. The main thing that moved was latency, not quality.
Re: whisper alternatives lately on M3 Max - cozykite - 10-18-2026
Quote:I hit almost the same issue last night.
Did a small comparison this afternoon. On Threadripper box with PyTorch, I saw basically the same behavior. The main thing that moved was latency, not quality.
Re: whisper alternatives lately on M3 Max - visionforge - 10-18-2026
I hit almost the same issue last night.