Inference
best local open-weight model this week with LM Studio - Printable Version

+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: LLM Models (https://www.datasculpting.ai/inference/forumdisplay.php?fid=12)
+--- Forum: Proprietary / Frontier (https://www.datasculpting.ai/inference/forumdisplay.php?fid=48)
+--- Thread: best local open-weight model this week with LM Studio (/showthread.php?tid=1005)



best local open-weight model this week with LM Studio - fastlab - 10-10-2026

Thought I'd post a small recipe because a lot of threads ask similar things.

Maybe useful as a starting point: vLLM on 5090, keeping tool calling in mind from the start.

Maybe useful as a starting point for newer folks.


Re: best local open-weight model this week with LM Studio - batchshed - 10-11-2026

Quote:Thought I'd post a small recipe because a lot of threads ask similar things.

That matches what I was seeing. I ended up in about the same place using Ollama.


Re: best local open-weight model this week with LM Studio - rocmriley - 10-11-2026

Quote:
Quote:Thought I'd post a small recipe because a lot of threads ask similar things.

Did a small comparison this afternoon. On A6000 with PyTorch, I saw basically the same behavior. The main thing that moved was latency, not quality.