Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
AWQ vs GPTQ vs GGUF right now on mini PC
#11
Did a small comparison this afternoon. On GB200 with TensorRT-LLM, I saw basically the same behavior. I expected the model choice to matter more than it did.

If you post your exact settings, people here can probably narrow it down pretty fast.
Reply


Messages In This Thread
Re: AWQ vs GPTQ vs GGUF right now on mini PC - by fastfield4 - 10-18-2026, 05:23 PM

Forum Jump:


Users browsing this thread: 1 Guest(s)