best local open-weight model this week

[llmpeak]

Ran a quick check on my box. I couldn't reproduce the slowdown until I pushed context much higher.

[mintstream9]

Ran a quick check on my box. I couldn't reproduce the slowdown until I pushed context much higher.

A couple things I'd check first. If you're on Ollama, I'd confirm the version first and then reduce variables until the behavior is obvious. A lot of these threads end up being one bad config plus a pile of conclusions drawn from it.

[turboscope5]

A couple things I'd check first. Before rebuilding anything, I'd test one clean baseline with Mistral and compare from there. A lot of these threads end up being one bad config plus a pile of conclusions drawn from it.

[thetanest]

Ran a quick check on my box. On mini PC with vLLM, I saw basically the same behavior.