good hosted AI app that still respects privacy

[sparrowhall]

[quote]That matches what I was seeing. I ended up in about the same place using TensorRT-LLM. Worth rechecking your defaults though, because one bad a

My first guess would be this: Before rebuilding anything, I'd test one clean baseline with DeepSeek and compare from there.