+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Drivers / Frameworks / Toolkits (https://www.datasculpting.ai/inference/forumdisplay.php?fid=8)
+--- Forum: AMD / ROCm (https://www.datasculpting.ai/inference/forumdisplay.php?fid=32)
+--- Thread: HIP kernel compile issue for Llama (/showthread.php?tid=717)
HIP kernel compile issue for Llama - thetaember38 - 10-03-2026
Posting this in case it saves someone else a little time.
I'm helping a small team set up a local workflow. We don't need a giant stack, but we do care about embeddings.
Would rather learn from your scars than collect my own all at once.
Re: HIP kernel compile issue for Llama - fastquill74 - 10-03-2026
Quote:Posting this in case it saves someone else a little time.
Appreciate the detail. That matches what I saw on 4090. Worth rechecking your defaults though, because one bad assumption can make the rest of the thread look confusing.
I'm happy to test one more variant if you want a second data point.