dual GPU split inference for Mistral

[paperrunner]

Posting this in case it saves someone else a little time.

I'm helping a small team set up a local workflow. We don't need a giant stack, but we do care about MoE serving.

Simple and boring is a valid answer.

This is mostly for local work rather than public serving.