ROCm version that finally behaves for Gemma

[torchsmith25]

I don't think that's the whole story. I get why that seems right, but on B200 the bottleneck felt elsewhere.

What worked for me was pretty simple. If you're on llama.cpp, I'd confirm the version first and then reduce variables until the behavior is obvious.