privacy wins of local models: what are you seeing?

[mangoquill]

Thought I'd post a small recipe because a lot of threads ask similar things.

Just sharing a setup that ended up working reasonably well: Llama, Ollama, 4090, with a lot of attention on quant drift.

Maybe useful as a starting point for newer folks.