flux pipeline local tips

[modbench]

that fixed it for me too.

that fixed it for me too.

I'm happy to test one more variant if you want a second data point.

[routeforge64]

I'd approach it in a boring order. Start by verifying the driver/runtime combo, then test with a smaller prompt, then look at tail latency.

[turboscope5]

Interesting, I hadn't tried that. That matches what I saw on A6000.

That matches what I was seeing. I don't think your conclusion is far off. I got better results once I stopped chasing one metric and just looked at whether the workflow felt usable.

[batchember]

Interesting, I hadn't tried that. That matches what I saw on A6000.