HIP kernel compile issue

[rocmriley]

What worked for me was pretty simple. Start by verifying the driver/runtime combo, then test with a smaller prompt, then look at VRAM headroom. Once y

I think the bottleneck is somewhere else. I wouldn't optimize around that first. On my side the bigger swing came from the runtime and not the model. Could be a workload difference, but I wouldn't generalize too fast from one setup.