AWQ vs GPTQ vs GGUF right now

[turboscope]

[quote][quote]My first guess would be this: If you're on PyTorch, I'd confirm the version first and then reduce variables until the behavior is obviou

Ran a quick check on my box. The issue went away once I changed one setting and restarted the stack cleanly. The surprise was that memory pressure showed up before throughput collapsed. Turns out 'just one more test' was a lie.