Inference
is RDNA worth the hassle yet on 5090 - Printable Version

+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Drivers / Frameworks / Toolkits (https://www.datasculpting.ai/inference/forumdisplay.php?fid=8)
+--- Forum: AMD / ROCm (https://www.datasculpting.ai/inference/forumdisplay.php?fid=32)
+--- Thread: is RDNA worth the hassle yet on 5090 (/showthread.php?tid=109)



is RDNA worth the hassle yet on 5090 - tensorworks - 09-03-2026

Did a bit of testing and thought I'd post the result here.

I tried this with Llama using Ollama on 7900 XTX. The headline result was better than I expected, but consumer GPUs still ended up being the limiting factor.

Curious if anyone else landed in the same place.

This is mostly for local work rather than public serving.