small speech stack for local use

[kernelpeak]

Did a bit of testing and thought I'd post the result here.

I tried this with DeepSeek using Ollama on M3 Max. The headline result was better than I expected, but long context still ended up being the limiting factor.

Happy to post more details if anyone wants them.

[sanevault]

Appreciate the detail. I ended up in about the same place using LM Studio. I got better results once I stopped chasing one metric and just looked at whether the workflow felt usable.

[deltastation]

I think the bottleneck is somewhere else. The reported numbers can look compelling, but in ordinary usage I didn't see the same benefit.