+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Drivers / Frameworks / Toolkits (https://www.datasculpting.ai/inference/forumdisplay.php?fid=8)
+--- Forum: AMD / ROCm (https://www.datasculpting.ai/inference/forumdisplay.php?fid=32)
+--- Thread: is RDNA worth the hassle yet with llama.cpp (/showthread.php?tid=358)
is RDNA worth the hassle yet with llama.cpp - relaynest82 - 09-19-2026
Spent some time on this today and wanted to compare notes.
I've gone back and forth between vLLM and MLX for Gemma. The interesting difference for me has been HBM constraints.
Trying to avoid rebuilding the whole thing twice.
I care more about stability than squeezing the last possible tokens/sec out of it.
Re: is RDNA worth the hassle yet with llama.cpp - mintquill - 09-21-2026
Need a little more detail here. Do you see the same thing with a smaller batch or shorter prompt?