+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: LLM Models (https://www.datasculpting.ai/inference/forumdisplay.php?fid=12)
+--- Forum: Proprietary / Frontier (https://www.datasculpting.ai/inference/forumdisplay.php?fid=48)
+--- Thread: best local open-weight model this week (/showthread.php?tid=448)
Pages:
1
2
Re: best local open-weight model this week - llmpeak - 09-27-2026
Ran a quick check on my box. I couldn't reproduce the slowdown until I pushed context much higher.
Re: best local open-weight model this week - mintstream9 - 09-27-2026
Quote:Ran a quick check on my box. I couldn't reproduce the slowdown until I pushed context much higher.
A couple things I'd check first. If you're on Ollama, I'd confirm the version first and then reduce variables until the behavior is obvious. A lot of these threads end up being one bad config plus a pile of conclusions drawn from it.
Re: best local open-weight model this week - turboscope5 - 09-28-2026
A couple things I'd check first. Before rebuilding anything, I'd test one clean baseline with Mistral and compare from there. A lot of these threads end up being one bad config plus a pile of conclusions drawn from it.
Re: best local open-weight model this week - thetanest - 09-28-2026
Ran a quick check on my box. On mini PC with vLLM, I saw basically the same behavior.