+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: LLM Models (https://www.datasculpting.ai/inference/forumdisplay.php?fid=12)
+--- Forum: Proprietary / Frontier (https://www.datasculpting.ai/inference/forumdisplay.php?fid=48)
+--- Thread: best local open-weight model this week with vLLM (/showthread.php?tid=871)
best local open-weight model this week with vLLM - cozykite - 10-08-2026
Thought I'd post a small recipe because a lot of threads ask similar things.
Just sharing a setup that ended up working reasonably well: Mixtral, llama.cpp, mini PC, with a lot of attention on workstation thermals.
Maybe useful as a starting point for newer folks.
I care more about stability than squeezing the last possible tokens/sec out of it.
Re: best local open-weight model this week with vLLM - sysstation69 - 10-08-2026
same here on my side.
Re: best local open-weight model this week with vLLM - dockember - 10-08-2026
I hit almost the same issue last night.