Inference
eval setup for local models - Printable Version

+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Evaluation & Testing (https://www.datasculpting.ai/inference/forumdisplay.php?fid=16)
+--- Forum: Benchmarks (https://www.datasculpting.ai/inference/forumdisplay.php?fid=65)
+--- Thread: eval setup for local models (/showthread.php?tid=382)

Pages: 1 2


Re: eval setup for local models - relayforge - 09-25-2026

Did a small comparison this afternoon. On mini PC with SGLang, I saw basically the same behavior.