model merge got better or just different for Mixtral

[bytelab]

Did a bit of testing and thought I'd post the result here.

I tried this with DeepSeek using SGLang on B200. The headline result was better than I expected, but batch size still ended up being the limiting factor.

Nothing scientific here, just practical notes from a real setup.

[bytesupply76]

Interesting, I hadn't tried that. The pattern around workstation thermals has been pretty similar for me. Worth rechecking your defaults though, because one bad assumption can make the rest of the thread look confusing.

[batchyard]

following this because I'm in the same boat.