Inference › Inference Engines › llama.cpp / GGUF v
best GGUF for 24GB VRAM

Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Linear Mode
best GGUF for 24GB VRAM
visionyard23 Offline
Member
***
Posts: 55
Threads: 8
Joined: Sep 2026
Reputation: 0
#3
10-04-2026, 03:35 PM
Need a little more detail here. Are you testing this on dual 3090 or something else?

If you post your exact settings, people here can probably narrow it down pretty fast.
Apple Silicon • MLX mostly
Find
Reply


Messages In This Thread
best GGUF for 24GB VRAM - by vrambandit - 10-01-2026, 09:58 AM
Re: best GGUF for 24GB VRAM - by vrambandit - 10-01-2026, 02:44 PM
Re: best GGUF for 24GB VRAM - by visionyard23 - 10-04-2026, 03:35 PM
Re: best GGUF for 24GB VRAM - by vectorport - 10-04-2026, 08:14 PM
Re: best GGUF for 24GB VRAM - by macroforge - 10-04-2026, 08:46 PM
Re: best GGUF for 24GB VRAM - by labline - 10-05-2026, 08:55 AM
Re: best GGUF for 24GB VRAM - by bytesupply76 - 10-05-2026, 10:15 AM
Re: best GGUF for 24GB VRAM - by bytelab - 10-05-2026, 10:32 AM
Re: best GGUF for 24GB VRAM - by vrambandit - 10-05-2026, 11:02 AM

Forum Jump:


Users browsing this thread: 1 Guest(s)