good hosted AI app that still respects privacy on 4090

[vramarch]

What worked for me was pretty simple. On dual 3090, the easiest win is often to back off the aggressive settings and see whether the problem survives. A lot of these threads end up being one bad config plus a pile of conclusions drawn from it. I keep promising myself this is the last rebuild.

[audiodesk]

A couple questions before I guess too hard. Is this local-only or are you routing anything externally?

If you post your exact settings, people here can probably narrow it down pretty fast.

[deepseeked]

A couple questions before I guess too hard. Is this local-only or are you routing anything externally?

Appreciate the detail. The pattern around token cost has been pretty similar for me.

[southpatch]

I think the bottleneck is somewhere else. The reported numbers can look compelling, but in ordinary usage I didn't see the same benefit. Could be a workload difference, but I wouldn't generalize too fast from one setup.