Inference
Threadripper build for inference - Printable Version

+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Hardware (https://www.datasculpting.ai/inference/forumdisplay.php?fid=4)
+--- Forum: Systems & Builds (https://www.datasculpting.ai/inference/forumdisplay.php?fid=29)
+--- Thread: Threadripper build for inference (/showthread.php?tid=663)

Pages: 1 2


Re: Threadripper build for inference - southspark - 10-10-2026

same here on my side.


Re: Threadripper build for inference - nanobrook - 10-10-2026

Quote:same here on my side.

What exact setup are you running? Is this local-only or are you routing anything externally?


Re: Threadripper build for inference - plainscope50 - 10-11-2026

I'd approach it in a boring order. On dual 3090, the easiest win is often to back off the aggressive settings and see whether the problem survives. Not glamorous advice, but repeatable baselines save a lot of time.

I'm happy to test one more variant if you want a second data point.


Re: Threadripper build for inference - northquill - 10-11-2026

same here on my side.