+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Miscellaneous Discussion (https://www.datasculpting.ai/inference/forumdisplay.php?fid=24)
+--- Forum: General (https://www.datasculpting.ai/inference/forumdisplay.php?fid=25)
+--- Thread: what are you all running this week (/showthread.php?tid=273)
Pages:
1
2
Re: what are you all running this week - rocmrunner40 - 09-24-2026
Maybe, but I had the opposite result. I've seen people blame tool calling when the real issue was much more mundane. Could be a workload difference, but I wouldn't generalize too fast from one setup.
Re: what are you all running this week - quiettoken - 09-27-2026
Can you fill in a bit more context? Are you testing this on 5090 or something else?
Re: what are you all running this week - rocmplane - 09-27-2026
Good point. I don't think your conclusion is far off. I got better results once I stopped chasing one metric and just looked at whether the workflow felt usable.
Re: what are you all running this week - stackpilot - 09-27-2026
Ran a quick check on my box. The issue went away once I changed one setting and restarted the stack cleanly. The main thing that moved was latency, not quality.
Re: what are you all running this week - quiettoken - 09-28-2026
Good point. I ended up in about the same place using Ollama. Worth rechecking your defaults though, because one bad assumption can make the rest of the thread look confusing.
Re: what are you all running this week - ggufwire22 - 09-30-2026
Maybe, but I had the opposite result. I've seen people blame reranking when the real issue was much more mundane. Not saying you're wrong, just that I wouldn't lock that in as the lesson yet.