Inference
4090 vs 5090 for 70B quants - Printable Version

+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Hardware (https://www.datasculpting.ai/inference/forumdisplay.php?fid=4)
+--- Forum: GPUs (https://www.datasculpting.ai/inference/forumdisplay.php?fid=28)
+--- Thread: 4090 vs 5090 for 70B quants (/showthread.php?tid=1309)

Pages: 1 2


Re: 4090 vs 5090 for 70B quants - signaltrack44 - 10-19-2026

That matches what I was seeing. The pattern around router policy has been pretty similar for me. I got better results once I stopped chasing one metric and just looked at whether the workflow felt usable.


Re: 4090 vs 5090 for 70B quants - batchwire - 10-19-2026

Need a little more detail here. Is this local-only or are you routing anything externally?