best local open-weight model this week

[quantghost]

Thought I'd post a small recipe because a lot of threads ask similar things.

Maybe useful as a starting point: Ollama on mini PC, keeping prefix caching in mind from the start.

Maybe useful as a starting point for newer folks.

This is mostly for local work rather than public serving.