whisper alternatives lately: anyone testing this?

[tensorworks]

worth checking the driver first.

[cobaltworks25]

Appreciate the detail. The pattern around small local stacks has been pretty similar for me. Worth rechecking your defaults though, because one bad assumption can make the rest of the thread look confusing.

I'm happy to test one more variant if you want a second data point.

[vectorfield]

Did a bit of testing and thought I'd post the result here.

After a few runs on B200, I ended up with decent performance, but the setup only really made sense once I adjusted around KV cache pressure.

Nothing scientific here, just practical notes from a real setup.

This is mostly for local work rather than public serving.

[cudascope]

What exact setup are you running? Are you testing this on 4090 or something else?