desktop apps around local AI

[batchshed]

Posting this in case it saves someone else a little time.

I'm helping a small team set up a local workflow. We don't need a giant stack, but we do care about VRAM headroom.

Simple and boring is a valid answer.

[modgarden]

Posting this in case it saves someone else a little time.

Interesting, I hadn't tried that. That matches what I saw on A6000. The biggest change for me was simplifying the stack instead of adding one more optimization layer.