image generation model locals actually use: what are you seeing?

[kernelgrid]

[quote][quote]Interesting, I hadn't tried that. That matches what I saw on 5090. The biggest change for me was simplifying the stack instead of adding

Not sure I agree there. I get why that seems right, but on mini PC the bottleneck felt elsewhere. Could be a workload difference, but I wouldn't generalize too fast from one setup.

[plainember52]

What worked for me was pretty simple. If you're on TensorRT-LLM, I'd confirm the version first and then reduce variables until the behavior is obvious. Once you know the plain path works, then add the faster path back in piece by piece.

[stackpilot]

I hit almost the same issue last night.