Multimodal discussion for FLUX

[vramscope]

Curious what people here are seeing.

I'm mostly working with DeepSeek in vLLM on M3 Max. The part I'm trying to understand is speculative decoding.

If you've tested something similar, what did you keep and what did you stop bothering with?

[vramport]

Curious what people here are seeing.

A couple things I'd check first. If you're on TensorRT-LLM, I'd confirm the version first and then reduce variables until the behavior is obvious. A lot of these threads end up being one bad config plus a pile of conclusions drawn from it.