quality tests for local assistants for Mistral

[oxidestream]

Good point. I don't think your conclusion is far off.

[sparrowkite53]

Can you fill in a bit more context? Is this local-only or are you routing anything externally?

[quietstack]

Good point. That matches what I saw on 4090. Worth rechecking your defaults though, because one bad assumption can make the rest of the thread look confusing.

[batchcraft]

worth checking the driver first.

[vectorhouse71]

Need a little more detail here. Do you see the same thing with a smaller batch or shorter prompt?