best GGUF for 24GB VRAM: early impressions

Thread Rating:

0 Vote(s) - 0 Average
1
2
3
4
5

Linear Mode

best GGUF for 24GB VRAM: early impressions

vrambandit Offline

Member

Posts: 168
Threads: 14
Joined: Sep 2026
Reputation: 0

#12

09-13-2026, 12:49 PM

Thanks, that helps. The pattern around quant drift has been pretty similar for me. I got better results once I stopped chasing one metric and just looked at whether the workflow felt usable.

2x3090 • llama.cpp • too much VRAM is still not enough

Find

« Next Oldest | Next Newest »

Messages In This Thread

best GGUF for 24GB VRAM: early impressions - by pixelcrate82 - 09-12-2026, 03:36 AM

Re: best GGUF for 24GB VRAM: early impressions - by northcraft90 - 09-12-2026, 05:58 AM

Re: best GGUF for 24GB VRAM: early impressions - by vectorport - 09-13-2026, 09:19 AM

Re: best GGUF for 24GB VRAM: early impressions - by pixelcrate82 - 09-12-2026, 06:10 AM

Re: best GGUF for 24GB VRAM: early impressions - by tensorkite - 09-13-2026, 10:15 AM

Re: best GGUF for 24GB VRAM: early impressions - by mellowwire98 - 09-12-2026, 07:28 AM

Re: best GGUF for 24GB VRAM: early impressions - by embershed99 - 09-12-2026, 07:55 PM

Re: best GGUF for 24GB VRAM: early impressions - by llmpeak - 09-12-2026, 10:40 PM

Re: best GGUF for 24GB VRAM: early impressions - by northcraft90 - 09-13-2026, 12:27 PM

Re: best GGUF for 24GB VRAM: early impressions - by macroforge - 09-13-2026, 07:22 AM

Re: best GGUF for 24GB VRAM: early impressions - by southden - 09-13-2026, 09:32 PM

Re: best GGUF for 24GB VRAM: early impressions - by visionyard23 - 09-13-2026, 07:53 AM

Re: best GGUF for 24GB VRAM: early impressions - by vrambandit - 09-13-2026, 12:49 PM

Re: best GGUF for 24GB VRAM: early impressions - by dockridge - 09-13-2026, 11:21 PM

Re: best GGUF for 24GB VRAM: early impressions - by vrambandit - 09-15-2026, 12:07 AM

View a Printable Version

Forum Jump:

Users browsing this thread: 1 Guest(s)

Login
Username:
Password:	Lost Password?
	Remember me

Sign in with X.com