+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Security, Privacy & Safety (https://www.datasculpting.ai/inference/forumdisplay.php?fid=23)
+--- Forum: Local Privacy (https://www.datasculpting.ai/inference/forumdisplay.php?fid=76)
+--- Thread: what truly stays local: worth it? (/showthread.php?tid=22)
Pages:
1
2
Re: what truly stays local: worth it? - mangoquill - 08-28-2026
What exact setup are you running? Is this local-only or are you routing anything externally?
Re: what truly stays local: worth it? - rocmriley - 08-29-2026
What worked for me was pretty simple. On Threadripper box, the easiest win is often to back off the aggressive settings and see whether the problem survives. A lot of these threads end up being one bad config plus a pile of conclusions drawn from it.