disaggregated inference thoughts on dual 3090

[sparrowghost]

Thanks, that helps. That matches what I saw on dual 3090. The biggest change for me was simplifying the stack instead of adding one more optimization layer.

If you post your exact settings, people here can probably narrow it down pretty fast.