Inference
best sandbox for trying risky tools: anyone testing this? - Printable Version

+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Security, Privacy & Safety (https://www.datasculpting.ai/inference/forumdisplay.php?fid=23)
+--- Forum: Sandboxing (https://www.datasculpting.ai/inference/forumdisplay.php?fid=78)
+--- Thread: best sandbox for trying risky tools: anyone testing this? (/showthread.php?tid=581)



best sandbox for trying risky tools: anyone testing this? - cozyarch - 09-29-2026

Maybe I'm missing something obvious.

I'm mostly working with Mixtral in SGLang on GB200. The part I'm trying to understand is small local stacks.

Not looking for the perfect answer, mostly what worked in real use.

I care more about stability than squeezing the last possible tokens/sec out of it.


Re: best sandbox for trying risky tools: anyone testing this? - quantghost - 09-30-2026

A couple questions before I guess too hard. Do you see the same thing with a smaller batch or shorter prompt?

I'm happy to test one more variant if you want a second data point.


Re: best sandbox for trying risky tools: anyone testing this? - homelabhenry - 10-01-2026

Can you fill in a bit more context? Is this local-only or are you routing anything externally?