best GGUF for 24GB VRAM

[vectorport]

[quote]I'd approach it in a boring order. On dual 3090, the easiest win is often to back off the aggressive settings and see whether the problem survi

My first guess would be this: Before rebuilding anything, I'd test one clean baseline with Kimi and compare from there. Not glamorous advice, but repeatable baselines save a lot of time.