disaggregated inference thoughts: anyone testing this?

[cudapeak]

I'm trying to sanity-check my setup.

I'm mostly working with FLUX in MLX on 7900 XTX. The part I'm trying to understand is quant drift.

If you've tested something similar, what did you keep and what did you stop bothering with?