09-24-2026, 04:03 AM
Maybe, but I had the opposite result. I've seen people blame tool calling when the real issue was much more mundane. Could be a workload difference, but I wouldn't generalize too fast from one setup.
|
what are you all running this week
|
|
09-24-2026, 04:03 AM
Maybe, but I had the opposite result. I've seen people blame tool calling when the real issue was much more mundane. Could be a workload difference, but I wouldn't generalize too fast from one setup.
09-27-2026, 04:19 AM
Can you fill in a bit more context? Are you testing this on 5090 or something else?
small models can still be useful
09-27-2026, 04:35 AM
Good point. I don't think your conclusion is far off. I got better results once I stopped chasing one metric and just looked at whether the workflow felt usable.
curious and caffeinated
09-27-2026, 05:59 AM
Ran a quick check on my box. The issue went away once I changed one setting and restarted the stack cleanly. The main thing that moved was latency, not quality.
09-28-2026, 06:33 PM
Good point. I ended up in about the same place using Ollama. Worth rechecking your defaults though, because one bad assumption can make the rest of the thread look confusing.
small models can still be useful
09-30-2026, 07:22 AM
Maybe, but I had the opposite result. I've seen people blame reranking when the real issue was much more mundane. Not saying you're wrong, just that I wouldn't lock that in as the lesson yet.
|
|
« Next Oldest | Next Newest »
|