odd little inference appliances: early impressions

[vramarch]

Good point. I ended up in about the same place using Ollama. I got better results once I stopped chasing one metric and just looked at whether the workflow felt usable.