Inference › Inference Engines › llama.cpp / GGUF v
best GGUF for 24GB VRAM: early impressions

Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Linear Mode
best GGUF for 24GB VRAM: early impressions
mellowwire98 Offline
Member
***
Posts: 60
Threads: 9
Joined: Aug 2026
Reputation: 0
#4
09-12-2026, 07:28 AM
A couple things I'd check first. On M3 Max, the easiest win is often to back off the aggressive settings and see whether the problem survives.
Find
Reply


Messages In This Thread
Re: best GGUF for 24GB VRAM: early impressions - by mellowwire98 - 09-12-2026, 07:28 AM

Forum Jump:


Users browsing this thread: 1 Guest(s)