AI pin style devices but useful? on 4090

[routeline23]

Good point. I ended up in about the same place using llama.cpp. The biggest change for me was simplifying the stack instead of adding one more optimization layer.