+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: LLM Models (https://www.datasculpting.ai/inference/forumdisplay.php?fid=12)
+--- Forum: Proprietary / Frontier (https://www.datasculpting.ai/inference/forumdisplay.php?fid=48)
+--- Thread: best local open-weight model this week (/showthread.php?tid=913)
Pages:
1
2
Re: best local open-weight model this week - plaingarden18 - 10-15-2026
What exact setup are you running? What model, what runtime, and roughly what context size?
Re: best local open-weight model this week - phasenode - 10-15-2026
A couple things I'd check first. On Threadripper box, the easiest win is often to back off the aggressive settings and see whether the problem survives.