LM Studio surprisingly handy

[fusedhall]

[quote][quote]Good point. The pattern around embeddings has been pretty similar for me. The biggest change for me was simplifying the stack instead of

I'd approach it in a boring order. On Threadripper box, the easiest win is often to back off the aggressive settings and see whether the problem survives. Not glamorous advice, but repeatable baselines save a lot of time.