+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Optimization & Performance (https://www.datasculpting.ai/inference/forumdisplay.php?fid=10)
+--- Forum: Quantization (https://www.datasculpting.ai/inference/forumdisplay.php?fid=40)
+--- Thread: AWQ vs GPTQ vs GGUF right now (/showthread.php?tid=152)
Pages:
1
2
Re: AWQ vs GPTQ vs GGUF right now - torchshed - 09-11-2026
same here on my side.
Re: AWQ vs GPTQ vs GGUF right now - phasestream53 - 09-14-2026
Maybe, but I had the opposite result. I get why that seems right, but on mini PC the bottleneck felt elsewhere. Not saying you're wrong, just that I wouldn't lock that in as the lesson yet.