simple local serving recipe on GB200

[batchshed]

[quote]What worked for me was pretty simple. On dual 3090, the easiest win is often to back off the aggressive settings and see whether the problem su

My first guess would be this: Start by verifying the driver/runtime combo, then test with a smaller prompt, then look at tokens/sec.