10-08-2026, 06:52 PM
Quote:Need a little more detail here. Do you see the same thing with a smaller batch or shorter prompt?
Thanks, that helps. I ended up in about the same place using Ollama. The biggest change for me was simplifying the stack instead of adding one more optimization layer.
There are a few different conversations hiding inside this thread, so being explicit about the goal helps.
serving stack tinkerer
