+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Hardware (https://www.datasculpting.ai/inference/forumdisplay.php?fid=4)
+--- Forum: GPUs (https://www.datasculpting.ai/inference/forumdisplay.php?fid=28)
+--- Thread: 4090 vs 5090 for 70B quants (/showthread.php?tid=256)
Pages:
1
2
Re: 4090 vs 5090 for 70B quants - batchwire - 09-17-2026
I tested this tonight. I couldn't reproduce the slowdown until I pushed context much higher.
Re: 4090 vs 5090 for 70B quants - signaltrack44 - 09-17-2026
Appreciate the detail. I don't think your conclusion is far off. I got better results once I stopped chasing one metric and just looked at whether the workflow felt usable.
Re: 4090 vs 5090 for 70B quants - rocmriley - 09-17-2026
Ran a quick check on my box. My result was mixed: first run looked bad, second run looked normal. I expected the model choice to matter more than it did.