+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Drivers / Frameworks / Toolkits (https://www.datasculpting.ai/inference/forumdisplay.php?fid=8)
+--- Forum: AMD / ROCm (https://www.datasculpting.ai/inference/forumdisplay.php?fid=32)
+--- Thread: HIP kernel compile issue (/showthread.php?tid=324)
Pages:
1
2
Re: HIP kernel compile issue - rocmriley - 09-25-2026
I'd approach it in a boring order. On 4090, the easiest win is often to back off the aggressive settings and see whether the problem survives. Once you know the plain path works, then add the faster path back in piece by piece.
Re: HIP kernel compile issue - oxideworks59 - 09-26-2026
A couple things I'd check first. If you're on MLX, I'd confirm the version first and then reduce variables until the behavior is obvious. Once you know the plain path works, then add the faster path back in piece by piece.
Re: HIP kernel compile issue - mellowwire98 - 09-26-2026
Need a little more detail here. What model, what runtime, and roughly what context size?
Re: HIP kernel compile issue - quantshed - 09-26-2026
A couple things I'd check first. If you're on vLLM, I'd confirm the version first and then reduce variables until the behavior is obvious.
Re: HIP kernel compile issue - macropoint - 09-26-2026
subscribed, curious where this lands.
Re: HIP kernel compile issue - torchsmith25 - 09-26-2026
I'd approach it in a boring order. If you're on PyTorch, I'd confirm the version first and then reduce variables until the behavior is obvious.