+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Drivers / Frameworks / Toolkits (https://www.datasculpting.ai/inference/forumdisplay.php?fid=8)
+--- Forum: AMD / ROCm (https://www.datasculpting.ai/inference/forumdisplay.php?fid=32)
+--- Thread: ROCm version that finally behaves: early impressions (/showthread.php?tid=645)
ROCm version that finally behaves: early impressions - cozywire - 10-01-2026
Did a bit of testing and thought I'd post the result here.
Short version: llama.cpp behaved well for me, but only after I stopped ignoring batch size.
Happy to post more details if anyone wants them.
Re: ROCm version that finally behaves: early impressions - batchyard - 10-02-2026
Quote:Did a bit of testing and thought I'd post the result here.
Not sure I agree there. I've seen people blame HBM constraints when the real issue was much more mundane. Worth testing the simpler explanation before adopting the more interesting one.