Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
AWQ vs GPTQ vs GGUF right now
#8
Quote:My first guess would be this: If you're on PyTorch, I'd confirm the version first and then reduce variables until the behavior is obvious.

that fixed it for me too.
Reply


Messages In This Thread
AWQ vs GPTQ vs GGUF right now - by cachelab - 08-27-2026, 05:56 AM
Re: AWQ vs GPTQ vs GGUF right now - by cudaline - 08-27-2026, 07:00 AM
Re: AWQ vs GPTQ vs GGUF right now - by torchshed - 08-27-2026, 07:49 AM
Re: AWQ vs GPTQ vs GGUF right now - by vramscope - 08-27-2026, 10:18 AM
Re: AWQ vs GPTQ vs GGUF right now - by cudaline - 08-28-2026, 01:08 PM
Re: AWQ vs GPTQ vs GGUF right now - by marbletrack - 08-28-2026, 02:01 PM
Re: AWQ vs GPTQ vs GGUF right now - by turboscope - 08-29-2026, 03:47 AM

Forum Jump:


Users browsing this thread: 1 Guest(s)