dual GPU split inference

[emberquill]

What worked for me was pretty simple. On B200, the easiest win is often to back off the aggressive settings and see whether the problem survives.

[quantshed]

I'd approach it in a boring order. Start by verifying the driver/runtime combo, then test with a smaller prompt, then look at long context.