|
HIP kernel compile issue
|
10-03-2026, 10:57 AM
Quote:Tried to reproduce it just now. I couldn't reproduce the slowdown until I pushed context much higher. I expected the model choice to matter more than I'd approach it in a boring order. If you're on MLX, I'd confirm the version first and then reduce variables until the behavior is obvious. A lot of these threads end up being one bad config plus a pile of conclusions drawn from it.
2x3090 • llama.cpp • too much VRAM is still not enough
|
|
« Next Oldest | Next Newest »
|
| Messages In This Thread |
|
HIP kernel compile issue - by thetaember38 - 10-02-2026, 05:53 AM
Re: HIP kernel compile issue - by mintquill - 10-02-2026, 06:20 PM
Re: HIP kernel compile issue - by northhall88 - 10-02-2026, 07:25 PM
Re: HIP kernel compile issue - by thetaember38 - 10-02-2026, 10:09 PM
Re: HIP kernel compile issue - by batchyard - 10-03-2026, 10:27 AM
Re: HIP kernel compile issue - by vrambandit - 10-03-2026, 10:57 AM
Re: HIP kernel compile issue - by rocmmixer - 10-06-2026, 11:07 AM
Re: HIP kernel compile issue - by mangofield33 - 10-06-2026, 11:46 AM
|
