09-05-2026, 09:13 PM
Quote:My first guess would be this: Before rebuilding anything, I'd test one clean baseline with FLUX and compare from there.
Did a small comparison this afternoon. I couldn't reproduce the slowdown until I pushed context much higher. The main thing that moved was latency, not quality.
throughput matters, but tail latency matters too