+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Evaluation & Testing (https://www.datasculpting.ai/inference/forumdisplay.php?fid=16)
+--- Forum: Benchmarks (https://www.datasculpting.ai/inference/forumdisplay.php?fid=65)
+--- Thread: benchmark result I don't trust: anyone testing this? (/showthread.php?tid=1295)
Pages:
1
2
Re: benchmark result I don't trust: anyone testing this? - cacheline - 10-19-2026
I'd start with the simpler stack.
Re: benchmark result I don't trust: anyone testing this? - cacheline - 10-19-2026
Interesting, I hadn't tried that. I don't think your conclusion is far off. I got better results once I stopped chasing one metric and just looked at whether the workflow felt usable.
Re: benchmark result I don't trust: anyone testing this? - batchfield55 - 10-19-2026
Can you fill in a bit more context? What model, what runtime, and roughly what context size?
If you post your exact settings, people here can probably narrow it down pretty fast.
Re: benchmark result I don't trust: anyone testing this? - routearch - 10-19-2026
Thanks, that helps. I ended up in about the same place using Ollama. I got better results once I stopped chasing one metric and just looked at whether the workflow felt usable. The logs were somehow calmer than I was.