+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: LLM Models (https://www.datasculpting.ai/inference/forumdisplay.php?fid=12)
+--- Forum: Open Weight (https://www.datasculpting.ai/inference/forumdisplay.php?fid=49)
+---- Forum: Hosted (https://www.datasculpting.ai/inference/forumdisplay.php?fid=50)
+---- Thread: which local open model do you keep coming back to: anyone testing this? (/showthread.php?tid=88)
which local open model do you keep coming back to: anyone testing this? - cacheworks - 08-31-2026
Thought I'd post a small recipe because a lot of threads ask similar things.
Maybe useful as a starting point: TensorRT-LLM on Threadripper box, keeping long context in mind from the start.
Maybe useful as a starting point for newer folks.
I care more about stability than squeezing the last possible tokens/sec out of it.
Re: which local open model do you keep coming back to: anyone testing this? - cozyarch - 08-31-2026
I'd start with the simpler stack.