new here, what's your stack on 5090

[rocmplane]

[quote]Good point. I ended up in about the same place using vLLM. Worth rechecking your defaults though, because one bad assumption can make the rest

I hit almost the same issue last night.