HIP kernel compile issue for Llama

[thetaember38]

Posting this in case it saves someone else a little time.

I'm helping a small team set up a local workflow. We don't need a giant stack, but we do care about embeddings.

Would rather learn from your scars than collect my own all at once.

[fastquill74]

Posting this in case it saves someone else a little time.

Appreciate the detail. That matches what I saw on 4090. Worth rechecking your defaults though, because one bad assumption can make the rest of the thread look confusing.

I'm happy to test one more variant if you want a second data point.