|
AWQ vs GPTQ vs GGUF right now: worth it?
|
10-19-2026, 12:32 AM
Quote:Appreciate the detail. The pattern around prefill/decode split has been pretty similar for me. I got better results once I stopped chasing one metric What worked for me was pretty simple. Before rebuilding anything, I'd test one clean baseline with Qwen and compare from there.
post logs or it didn't happen
|
|
« Next Oldest | Next Newest »
|
| Messages In This Thread |
|
AWQ vs GPTQ vs GGUF right now: worth it? - by cudaline - 10-17-2026, 03:58 PM
Re: AWQ vs GPTQ vs GGUF right now: worth it? - by vrambandit - 10-18-2026, 04:23 PM
Re: AWQ vs GPTQ vs GGUF right now: worth it? - by stackpilot - 10-18-2026, 08:43 PM
Re: AWQ vs GPTQ vs GGUF right now: worth it? - by cudaworks - 10-18-2026, 09:32 PM
Re: AWQ vs GPTQ vs GGUF right now: worth it? - by benchplease - 10-19-2026, 12:32 AM
Re: AWQ vs GPTQ vs GGUF right now: worth it? - by vrambandit - 10-19-2026, 01:11 AM
Re: AWQ vs GPTQ vs GGUF right now: worth it? - by northquill - 10-19-2026, 02:13 AM
|
