09-07-2026, 10:14 AM
Ran a quick check on my box. My result was mixed: first run looked bad, second run looked normal. The surprise was that memory pressure showed up before throughput collapsed.
small models can still be good
|
AWQ vs GPTQ vs GGUF right now
|
|
« Next Oldest | Next Newest »
|
| Messages In This Thread |
|
AWQ vs GPTQ vs GGUF right now - by phasestream53 - 09-06-2026, 01:24 AM
Re: AWQ vs GPTQ vs GGUF right now - by marbletrack - 09-07-2026, 02:04 AM
Re: AWQ vs GPTQ vs GGUF right now - by northquill - 09-07-2026, 06:06 AM
Re: AWQ vs GPTQ vs GGUF right now - by sanevault - 09-07-2026, 10:14 AM
Re: AWQ vs GPTQ vs GGUF right now - by benchplease - 09-07-2026, 11:00 PM
Re: AWQ vs GPTQ vs GGUF right now - by turboscope - 09-08-2026, 11:02 AM
Re: AWQ vs GPTQ vs GGUF right now - by torchshed - 09-11-2026, 05:25 PM
Re: AWQ vs GPTQ vs GGUF right now - by benchplease - 09-08-2026, 12:16 PM
Re: AWQ vs GPTQ vs GGUF right now - by mangopeak72 - 09-08-2026, 02:32 PM
Re: AWQ vs GPTQ vs GGUF right now - by mangohouse - 09-10-2026, 02:43 AM
Re: AWQ vs GPTQ vs GGUF right now - by quantshed - 09-10-2026, 04:50 AM
Re: AWQ vs GPTQ vs GGUF right now - by phasestream53 - 09-14-2026, 05:43 PM
|
Users browsing this thread: 1 Guest(s)