Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
AWQ vs GPTQ vs GGUF right now on mini PC
#8
Quote:Thanks, that helps. The pattern around VRAM headroom has been pretty similar for me. The biggest change for me was simplifying the stack instead of ad

Appreciate the detail. The pattern around HBM constraints has been pretty similar for me. I got better results once I stopped chasing one metric and just looked at whether the workflow felt usable.
Reply


Messages In This Thread
Re: AWQ vs GPTQ vs GGUF right now on mini PC - by turboscope - 10-16-2026, 07:58 PM

Forum Jump:


Users browsing this thread: 1 Guest(s)