+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Miscellaneous Discussion (https://www.datasculpting.ai/inference/forumdisplay.php?fid=24)
+--- Forum: General (https://www.datasculpting.ai/inference/forumdisplay.php?fid=25)
+--- Thread: new here, what's your stack on Threadripper box (/showthread.php?tid=1193)
new here, what's your stack on Threadripper box - rocmplane - 10-13-2026
Posting this in case it saves someone else a little time.
I'm helping a small team set up a local workflow. We don't need a giant stack, but we do care about consumer GPUs.
I'm especially interested in mistakes worth avoiding.
This is mostly for local work rather than public serving.
Re: new here, what's your stack on Threadripper box - ggufwire22 - 10-13-2026
A couple things I'd check first. Start by verifying the driver/runtime combo, then test with a smaller prompt, then look at small local stacks. A lot of these threads end up being one bad config plus a pile of conclusions drawn from it.