+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Security, Privacy & Safety (https://www.datasculpting.ai/inference/forumdisplay.php?fid=23)
+--- Forum: Local Privacy (https://www.datasculpting.ai/inference/forumdisplay.php?fid=76)
+--- Thread: privacy wins of local models with PyTorch (/showthread.php?tid=38)
privacy wins of local models with PyTorch - mlxgarden - 08-26-2026
Curious what people here are seeing.
My current setup is SGLang with 7900 XTX, and I keep running into batch size.
Would appreciate practical advice rather than theory. The logs were somehow calmer than I was.
Re: privacy wins of local models with PyTorch - rocmriley - 08-26-2026
Appreciate the detail. The pattern around quant drift has been pretty similar for me. Worth rechecking your defaults though, because one bad assumption can make the rest of the thread look confusing.