routing between local and hosted

[turboscope]

Good point. I ended up in about the same place using llama.cpp. The biggest change for me was simplifying the stack instead of adding one more optimiz

following this because I'm in the same boat.