desktop apps around local AI

[mintstation99]

That matches what I was seeing. I ended up in about the same place using LM Studio. The biggest change for me was simplifying the stack instead of add

Can you fill in a bit more context? What model, what runtime, and roughly what context size?

[batchshed]

What worked for me was pretty simple. Before rebuilding anything, I'd test one clean baseline with DeepSeek and compare from there.

[vectorport]

Maybe, but I had the opposite result. The reported numbers can look compelling, but in ordinary usage I didn't see the same benefit. Could be a workload difference, but I wouldn't generalize too fast from one setup.

[rocmhouse90]

Good point. The pattern around VRAM headroom has been pretty similar for me. I got better results once I stopped chasing one metric and just looked at whether the workflow felt usable.

[vramstream]

Appreciate the detail. I ended up in about the same place using Ollama.

[deltagrid]

A couple things I'd check first. Before rebuilding anything, I'd test one clean baseline with Qwen and compare from there. A lot of these threads end up being one bad config plus a pile of conclusions drawn from it. At this point the real bottleneck is my patience.