good hosted AI app that still respects privacy with vLLM

[torchsmith25]

Thanks, that helps. I ended up in about the same place using llama.cpp.