+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Inference Engines (https://www.datasculpting.ai/inference/forumdisplay.php?fid=9)
+--- Forum: llama.cpp / GGUF (https://www.datasculpting.ai/inference/forumdisplay.php?fid=35)
+--- Thread: best GGUF for 24GB VRAM (/showthread.php?tid=69)
Pages:
1
2
Re: best GGUF for 24GB VRAM - stackpilot - 09-05-2026
following this because I'm in the same boat.
Re: best GGUF for 24GB VRAM - mellowwire98 - 09-06-2026
Tried to reproduce it just now. I couldn't reproduce the slowdown until I pushed context much higher.