10-19-2026, 02:13 AM
Appreciate the detail. The pattern around prefill/decode split has been pretty similar for me. I got better results once I stopped chasing one metric and just looked at whether the workflow felt usable.
|
AWQ vs GPTQ vs GGUF right now: worth it?
|
|
« Next Oldest | Next Newest »
|
| Messages In This Thread |
|
AWQ vs GPTQ vs GGUF right now: worth it? - by cudaline - 10-17-2026, 03:58 PM
Re: AWQ vs GPTQ vs GGUF right now: worth it? - by vrambandit - 10-18-2026, 04:23 PM
Re: AWQ vs GPTQ vs GGUF right now: worth it? - by stackpilot - 10-18-2026, 08:43 PM
Re: AWQ vs GPTQ vs GGUF right now: worth it? - by cudaworks - 10-18-2026, 09:32 PM
Re: AWQ vs GPTQ vs GGUF right now: worth it? - by benchplease - 10-19-2026, 12:32 AM
Re: AWQ vs GPTQ vs GGUF right now: worth it? - by vrambandit - 10-19-2026, 01:11 AM
Re: AWQ vs GPTQ vs GGUF right now: worth it? - by northquill - 10-19-2026, 02:13 AM
|
Users browsing this thread: 1 Guest(s)