Inference › Inference Engines › llama.cpp / GGUF v
best GGUF for 24GB VRAM

Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Linear Mode
best GGUF for 24GB VRAM
vrambandit Offline
Member
***
Posts: 168
Threads: 14
Joined: Sep 2026
Reputation: 0
#9
10-05-2026, 11:02 AM
Appreciate the detail. The pattern around workstation thermals has been pretty similar for me. Worth rechecking your defaults though, because one bad assumption can make the rest of the thread look confusing.
2x3090 • llama.cpp • too much VRAM is still not enough
Find
Reply


Messages In This Thread
best GGUF for 24GB VRAM - by vrambandit - 10-01-2026, 09:58 AM
Re: best GGUF for 24GB VRAM - by vrambandit - 10-01-2026, 02:44 PM
Re: best GGUF for 24GB VRAM - by visionyard23 - 10-04-2026, 03:35 PM
Re: best GGUF for 24GB VRAM - by vectorport - 10-04-2026, 08:14 PM
Re: best GGUF for 24GB VRAM - by macroforge - 10-04-2026, 08:46 PM
Re: best GGUF for 24GB VRAM - by labline - 10-05-2026, 08:55 AM
Re: best GGUF for 24GB VRAM - by bytesupply76 - 10-05-2026, 10:15 AM
Re: best GGUF for 24GB VRAM - by bytelab - 10-05-2026, 10:32 AM
Re: best GGUF for 24GB VRAM - by vrambandit - 10-05-2026, 11:02 AM

Forum Jump:


Users browsing this thread: 1 Guest(s)