+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Apps / Utilities / Tools (https://www.datasculpting.ai/inference/forumdisplay.php?fid=18)
+--- Forum: Online / Hosted (https://www.datasculpting.ai/inference/forumdisplay.php?fid=19)
+--- Thread: good hosted AI app that still respects privacy (/showthread.php?tid=1236)
Pages:
1
2
Re: good hosted AI app that still respects privacy - modbench - 10-18-2026
Quote:That matches what I was seeing. I ended up in about the same place using TensorRT-LLM. Worth rechecking your defaults though, because one bad assumpti
Interesting, I hadn't tried that. The pattern around structured output has been pretty similar for me. Worth rechecking your defaults though, because one bad assumption can make the rest of the thread look confusing.
Re: good hosted AI app that still respects privacy - sparrowhall - 10-18-2026
Quote:[quote]That matches what I was seeing. I ended up in about the same place using TensorRT-LLM. Worth rechecking your defaults though, because one bad a
My first guess would be this: Before rebuilding anything, I'd test one clean baseline with DeepSeek and compare from there.
Re: good hosted AI app that still respects privacy - deepseeked - 10-18-2026
Thanks, that helps. I don't think your conclusion is far off.