CUDA update broke my throughput

[cobaltspark]

That matches what I was seeing. That matches what I saw on dual 3090. Worth rechecking your defaults though, because one bad assumption can make the r

I tested this tonight. On 5090 with vLLM, I saw basically the same behavior. I expected the model choice to matter more than it did.