best GGUF for 24GB VRAM

[embershed99]

This keeps coming up in conversation so I figured I'd start a thread.

One thing I keep noticing is that people underestimate small local stacks until they actually try to run this stuff for more than one afternoon.

Curious whether that lines up with what other people are seeing.

I care more about stability than squeezing the last possible tokens/sec out of it.

[phasescope]

My first guess would be this: If you're on llama.cpp, I'd confirm the version first and then reduce variables until the behavior is obvious.

[mangotinker73]

I'd start with the simpler stack.