Inference › Inference Engines › llama.cpp / GGUF v
best GGUF for 24GB VRAM

Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Linear Mode
best GGUF for 24GB VRAM
vectorport Offline
Member
***
Posts: 80
Threads: 11
Joined: Aug 2026
Reputation: 0
#4
10-04-2026, 08:14 PM
Good point. The pattern around small local stacks has been pretty similar for me. The biggest change for me was simplifying the stack instead of adding one more optimization layer.
Find
Reply


Messages In This Thread
best GGUF for 24GB VRAM - by vrambandit - 10-01-2026, 09:58 AM
Re: best GGUF for 24GB VRAM - by vrambandit - 10-01-2026, 02:44 PM
Re: best GGUF for 24GB VRAM - by visionyard23 - 10-04-2026, 03:35 PM
Re: best GGUF for 24GB VRAM - by vectorport - 10-04-2026, 08:14 PM
Re: best GGUF for 24GB VRAM - by macroforge - 10-04-2026, 08:46 PM
Re: best GGUF for 24GB VRAM - by labline - 10-05-2026, 08:55 AM
Re: best GGUF for 24GB VRAM - by bytesupply76 - 10-05-2026, 10:15 AM
Re: best GGUF for 24GB VRAM - by bytelab - 10-05-2026, 10:32 AM
Re: best GGUF for 24GB VRAM - by vrambandit - 10-05-2026, 11:02 AM

Forum Jump:


Users browsing this thread: 1 Guest(s)