+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Evaluation & Testing (https://www.datasculpting.ai/inference/forumdisplay.php?fid=16)
+--- Forum: Evals (https://www.datasculpting.ai/inference/forumdisplay.php?fid=66)
+--- Thread: human evals on small teams (/showthread.php?tid=1341)
Pages:
1
2
Re: human evals on small teams - audioriver - 10-18-2026
Quote:A couple things I'd check first. If you're on LM Studio, I'd confirm the version first and then reduce variables until the behavior is obvious.
I'd approach it in a boring order. If you're on TensorRT-LLM, I'd confirm the version first and then reduce variables until the behavior is obvious. Not glamorous advice, but repeatable baselines save a lot of time.
Re: human evals on small teams - cobaltspark - 10-18-2026
Quote:[quote]A couple things I'd check first. If you're on LM Studio, I'd confirm the version first and then reduce variables until the behavior is obvious.
What exact setup are you running? What model, what runtime, and roughly what context size?
Re: human evals on small teams - pixelspark - 10-19-2026
Interesting, I hadn't tried that. I don't think your conclusion is far off. The biggest change for me was simplifying the stack instead of adding one more optimization layer.
Re: human evals on small teams - modbench - 10-19-2026
Thanks, that helps. I don't think your conclusion is far off. The biggest change for me was simplifying the stack instead of adding one more optimization layer.
Re: human evals on small teams - southspark - 10-19-2026
What exact setup are you running? Is this local-only or are you routing anything externally?
Re: human evals on small teams - relayforge - 10-19-2026
Thanks, that helps. I don't think your conclusion is far off.