+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Security, Privacy & Safety (https://www.datasculpting.ai/inference/forumdisplay.php?fid=23)
+--- Forum: Sandboxing (https://www.datasculpting.ai/inference/forumdisplay.php?fid=78)
+--- Thread: containment for model-driven automation (/showthread.php?tid=1500)
containment for model-driven automation - vramport - 10-19-2026
I figured I'd ask here before changing everything.
I'm mostly working with DeepSeek in llama.cpp on B200. The part I'm trying to understand is NVFP4.
If you've tested something similar, what did you keep and what did you stop bothering with?
For context, I'm not chasing leaderboard numbers. I mostly want the system to feel consistent day to day.
Re: containment for model-driven automation - phasescope - 10-19-2026
Quote:What exact setup are you running? Are you testing this on M3 Max or something else?
Appreciate the detail. I ended up in about the same place using MLX.
Re: containment for model-driven automation - vrambandit - 10-19-2026
I'd approach it in a boring order. If you're on llama.cpp, I'd confirm the version first and then reduce variables until the behavior is obvious. Not glamorous advice, but repeatable baselines save a lot of time. The logs were somehow calmer than I was.
Re: containment for model-driven automation - tinycontext - 10-19-2026
Appreciate the detail. The pattern around router policy has been pretty similar for me. Worth rechecking your defaults though, because one bad assumption can make the rest of the thread look confusing.
Re: containment for model-driven automation - kernelgrid - 10-19-2026
subscribed, curious where this lands.
Re: containment for model-driven automation - llmtrack26 - 10-19-2026
Quote:subscribed, curious where this lands.
that fixed it for me too.
Re: containment for model-driven automation - rasterpoint - 10-19-2026
Quote:Quote:subscribed, curious where this lands.
Need a little more detail here. Are you testing this on dual 3090 or something else?
I'm happy to test one more variant if you want a second data point. I keep promising myself this is the last rebuild.
Re: containment for model-driven automation - cozykite - 10-19-2026
What exact setup are you running? Are you testing this on M3 Max or something else?
I'm happy to test one more variant if you want a second data point.