Inference › Optimization & Performance › Quantization v
AWQ vs GPTQ vs GGUF right now

Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Linear Mode
AWQ vs GPTQ vs GGUF right now
turboscope Offline
Junior Member
**
Posts: 35
Threads: 8
Joined: Aug 2026
Reputation: 0
#1
09-04-2026, 03:09 AM
Posting this in case it saves someone else a little time.

I'm not trying to build a perfect architecture diagram. I just want a sane starting point around vLLM and mini PC.

Would rather learn from your scars than collect my own all at once.
Find
Reply


Messages In This Thread
AWQ vs GPTQ vs GGUF right now - by turboscope - 09-04-2026, 03:09 AM
Re: AWQ vs GPTQ vs GGUF right now - by ggufvault - 09-06-2026, 03:55 AM
Re: AWQ vs GPTQ vs GGUF right now - by turboscope - 09-06-2026, 06:39 AM

Forum Jump:


Users browsing this thread: 1 Guest(s)