LM Studio surprisingly handy for Mistral

[mellowwire98]

Spent some time on this today and wanted to compare notes.

I'm comparing two approaches here: keep it simple on GB200, or squeeze more out of the stack and deal with the complexity.

Trying to avoid rebuilding the whole thing twice.

[northcraft90]

A couple things I'd check first. Start by verifying the driver/runtime combo, then test with a smaller prompt, then look at router policy. A lot of these threads end up being one bad config plus a pile of conclusions drawn from it.

[cudahouse]

A couple things I'd check first. Start by verifying the driver/runtime combo, then test with a smaller prompt, then look at router policy. A lot of th

What worked for me was pretty simple. On 4090, the easiest win is often to back off the aggressive settings and see whether the problem survives. Once you know the plain path works, then add the faster path back in piece by piece.