do you even need a vector DB here for Mistral

[rocmplane]

that fixed it for me too.

Good point. The pattern around MoE serving has been pretty similar for me. Worth rechecking your defaults though, because one bad assumption can make the rest of the thread look confusing.