+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Generative AI (https://www.datasculpting.ai/inference/forumdisplay.php?fid=17)
+--- Forum: Image (https://www.datasculpting.ai/inference/forumdisplay.php?fid=69)
+--- Thread: small speech stack for local use (/showthread.php?tid=1009)
small speech stack for local use - kernelpeak - 10-11-2026
Did a bit of testing and thought I'd post the result here.
I tried this with DeepSeek using Ollama on M3 Max. The headline result was better than I expected, but long context still ended up being the limiting factor.
Happy to post more details if anyone wants them.
Re: small speech stack for local use - sanevault - 10-11-2026
Appreciate the detail. I ended up in about the same place using LM Studio. I got better results once I stopped chasing one metric and just looked at whether the workflow felt usable.
Re: small speech stack for local use - deltastation - 10-11-2026
I think the bottleneck is somewhere else. The reported numbers can look compelling, but in ordinary usage I didn't see the same benefit.