Inference › Optimization & Performance › Quantization v
AWQ vs GPTQ vs GGUF right now

Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Linear Mode
AWQ vs GPTQ vs GGUF right now
stackpilot Offline
Junior Member
**
Posts: 39
Threads: 5
Joined: Sep 2026
Reputation: 0
#14
10-12-2026, 11:34 PM
Thanks, that helps. I don't think your conclusion is far off. The biggest change for me was simplifying the stack instead of adding one more optimization layer.
Find
Reply


Messages In This Thread
AWQ vs GPTQ vs GGUF right now - by plainline - 10-10-2026, 11:05 PM
Re: AWQ vs GPTQ vs GGUF right now - by bytehall - 10-11-2026, 07:41 AM
Re: AWQ vs GPTQ vs GGUF right now - by fastbench - 10-11-2026, 08:34 AM
Re: AWQ vs GPTQ vs GGUF right now - by cudaline - 10-11-2026, 09:11 AM
Re: AWQ vs GPTQ vs GGUF right now - by cudaline - 10-11-2026, 10:39 AM
Re: AWQ vs GPTQ vs GGUF right now - by fastbench - 10-11-2026, 11:31 AM
Re: AWQ vs GPTQ vs GGUF right now - by audionode8 - 10-11-2026, 12:45 PM
Re: AWQ vs GPTQ vs GGUF right now - by bytehall - 10-11-2026, 06:19 PM
Re: AWQ vs GPTQ vs GGUF right now - by vrambandit - 10-12-2026, 10:52 AM
Re: AWQ vs GPTQ vs GGUF right now - by stackpilot - 10-12-2026, 11:34 PM
Re: AWQ vs GPTQ vs GGUF right now - by cudaline - 10-13-2026, 04:22 AM

Forum Jump:


Users browsing this thread: 1 Guest(s)