CPU-only fallback performance on 7900 XTX

[benchplease]

I figured I'd ask here before changing everything.

I'm mostly working with FLUX in Ollama on A6000. The part I'm trying to understand is prefix caching.

If you've tested something similar, what did you keep and what did you stop bothering with?

[kernelrunner]

I figured I'd ask here before changing everything.

Maybe, but I had the opposite result. I get why that seems right, but on B200 the bottleneck felt elsewhere. Not saying you're wrong, just that I wouldn't lock that in as the lesson yet.

[cacheplane98]

Did a small comparison this afternoon. My result was mixed: first run looked bad, second run looked normal.