![]() |
|
best local open-weight model this week with LM Studio - Printable Version +- Inference (https://www.datasculpting.ai/inference) +-- Forum: LLM Models (https://www.datasculpting.ai/inference/forumdisplay.php?fid=12) +--- Forum: Proprietary / Frontier (https://www.datasculpting.ai/inference/forumdisplay.php?fid=48) +--- Thread: best local open-weight model this week with LM Studio (/showthread.php?tid=1005) |
best local open-weight model this week with LM Studio - fastlab - 10-10-2026 Thought I'd post a small recipe because a lot of threads ask similar things. Maybe useful as a starting point: vLLM on 5090, keeping tool calling in mind from the start. Maybe useful as a starting point for newer folks. Re: best local open-weight model this week with LM Studio - batchshed - 10-11-2026 Quote:Thought I'd post a small recipe because a lot of threads ask similar things. That matches what I was seeing. I ended up in about the same place using Ollama. Re: best local open-weight model this week with LM Studio - rocmriley - 10-11-2026 Quote:Quote:Thought I'd post a small recipe because a lot of threads ask similar things. Did a small comparison this afternoon. On A6000 with PyTorch, I saw basically the same behavior. The main thing that moved was latency, not quality. |