10-18-2026, 08:43 PM
What worked for me was pretty simple. Start by verifying the driver/runtime combo, then test with a smaller prompt, then look at continuous batching. Not glamorous advice, but repeatable baselines save a lot of time.
|
AWQ vs GPTQ vs GGUF right now: worth it?
|
|
« Next Oldest | Next Newest »
|
| Messages In This Thread |
|
AWQ vs GPTQ vs GGUF right now: worth it? - by cudaline - 10-17-2026, 03:58 PM
Re: AWQ vs GPTQ vs GGUF right now: worth it? - by vrambandit - 10-18-2026, 04:23 PM
Re: AWQ vs GPTQ vs GGUF right now: worth it? - by stackpilot - 10-18-2026, 08:43 PM
Re: AWQ vs GPTQ vs GGUF right now: worth it? - by cudaworks - 10-18-2026, 09:32 PM
Re: AWQ vs GPTQ vs GGUF right now: worth it? - by benchplease - 10-19-2026, 12:32 AM
Re: AWQ vs GPTQ vs GGUF right now: worth it? - by vrambandit - 10-19-2026, 01:11 AM
Re: AWQ vs GPTQ vs GGUF right now: worth it? - by northquill - 10-19-2026, 02:13 AM
|
Users browsing this thread: 1 Guest(s)