small speech stack for local use: anyone testing this?

[quiethouse]

Thanks, that helps. The pattern around INT4 has been pretty similar for me. I got better results once I stopped chasing one metric and just looked at

What worked for me was pretty simple. On B200, the easiest win is often to back off the aggressive settings and see whether the problem survives. A lot of these threads end up being one bad config plus a pile of conclusions drawn from it.