desktop apps around local AI on 5090

[mintstation99]

What worked for me was pretty simple. On A6000, the easiest win is often to back off the aggressive settings and see whether the problem survives. Not glamorous advice, but repeatable baselines save a lot of time.

There are a few different conversations hiding inside this thread, so being explicit about the goal helps.

[audioriver]

A couple things I'd check first. On 7900 XTX, the easiest win is often to back off the aggressive settings and see whether the problem survives. Once you know the plain path works, then add the faster path back in piece by piece. At this point the real bottleneck is my patience.

[mlxgarden]

My first guess would be this: Before rebuilding anything, I'd test one clean baseline with Gemma and compare from there.

[rocmhouse90]

A couple things I'd check first. On M3 Max, the easiest win is often to back off the aggressive settings and see whether the problem survives. A lot of these threads end up being one bad config plus a pile of conclusions drawn from it.