![]() |
|
eval setup for local models - Printable Version +- Inference (https://www.datasculpting.ai/inference) +-- Forum: Evaluation & Testing (https://www.datasculpting.ai/inference/forumdisplay.php?fid=16) +--- Forum: Benchmarks (https://www.datasculpting.ai/inference/forumdisplay.php?fid=65) +--- Thread: eval setup for local models (/showthread.php?tid=382) Pages:
1
2
|
Re: eval setup for local models - relayforge - 09-25-2026 Did a small comparison this afternoon. On mini PC with SGLang, I saw basically the same behavior. |