Inference
human evals on small teams - Printable Version

+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Evaluation & Testing (https://www.datasculpting.ai/inference/forumdisplay.php?fid=16)
+--- Forum: Evals (https://www.datasculpting.ai/inference/forumdisplay.php?fid=66)
+--- Thread: human evals on small teams (/showthread.php?tid=858)

Pages: 1 2


Re: human evals on small teams - tensorfield88 - 10-15-2026

Maybe, but I had the opposite result. I've seen people blame tool calling when the real issue was much more mundane.


Re: human evals on small teams - paperport64 - 10-18-2026

Did a small comparison this afternoon. I couldn't reproduce the slowdown until I pushed context much higher. The surprise was that memory pressure showed up before throughput collapsed.