good hosted AI app that still respects privacy with vLLM

[macronest]

Appreciate the detail. I ended up in about the same place using Ollama. The biggest change for me was simplifying the stack instead of adding one more optimization layer.