ROCm version that finally behaves for Qwen

[routecraft]

I figured I'd ask here before changing everything.

I'm mostly working with FLUX in MLX on 5090. The part I'm trying to understand is tokens/sec.

If you've tested something similar, what did you keep and what did you stop bothering with?

[rocmriley]

That matches what I was seeing. I don't think your conclusion is far off. The biggest change for me was simplifying the stack instead of adding one more optimization layer.

[tensorworks]

A couple things I'd check first. On Threadripper box, the easiest win is often to back off the aggressive settings and see whether the problem survives. Once you know the plain path works, then add the faster path back in piece by piece.

[macropoint]

What worked for me was pretty simple. On 7900 XTX, the easiest win is often to back off the aggressive settings and see whether the problem survives.

[dockworks23]

Ran a quick check on my box. On A6000 with PyTorch, I saw basically the same behavior. I expected the model choice to matter more than it did.

[batchyard]

A couple questions before I guess too hard. Is this local-only or are you routing anything externally?

[quantshed]

A couple things I'd check first. On dual 3090, the easiest win is often to back off the aggressive settings and see whether the problem survives.