best local open-weight model this week with LM Studio

[fastlab]

Thought I'd post a small recipe because a lot of threads ask similar things.

Maybe useful as a starting point: vLLM on 5090, keeping tool calling in mind from the start.

Maybe useful as a starting point for newer folks.

[batchshed]

Thought I'd post a small recipe because a lot of threads ask similar things.

That matches what I was seeing. I ended up in about the same place using Ollama.

[rocmriley]

Thought I'd post a small recipe because a lot of threads ask similar things.

Did a small comparison this afternoon. On A6000 with PyTorch, I saw basically the same behavior. The main thing that moved was latency, not quality.