Inference
is RDNA worth the hassle yet with SGLang - Printable Version

+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Drivers / Frameworks / Toolkits (https://www.datasculpting.ai/inference/forumdisplay.php?fid=8)
+--- Forum: AMD / ROCm (https://www.datasculpting.ai/inference/forumdisplay.php?fid=32)
+--- Thread: is RDNA worth the hassle yet with SGLang (/showthread.php?tid=659)

Pages: 1 2


Re: is RDNA worth the hassle yet with SGLang - rocmriley - 10-13-2026

I tested this tonight. On mini PC with Ollama, I saw basically the same behavior. I expected the model choice to matter more than it did.