+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Optimization & Performance (https://www.datasculpting.ai/inference/forumdisplay.php?fid=10)
+--- Forum: Quantization (https://www.datasculpting.ai/inference/forumdisplay.php?fid=40)
+--- Thread: AWQ vs GPTQ vs GGUF right now (/showthread.php?tid=116)
AWQ vs GPTQ vs GGUF right now - turboscope - 09-04-2026
Posting this in case it saves someone else a little time.
I'm not trying to build a perfect architecture diagram. I just want a sane starting point around vLLM and mini PC.
Would rather learn from your scars than collect my own all at once.
Re: AWQ vs GPTQ vs GGUF right now - ggufvault - 09-06-2026
I hit almost the same issue last night.
Re: AWQ vs GPTQ vs GGUF right now - turboscope - 09-06-2026
Quote:I hit almost the same issue last night.
A couple things I'd check first. Before rebuilding anything, I'd test one clean baseline with FLUX and compare from there. Not glamorous advice, but repeatable baselines save a lot of time.