PyTorch compile got faster? on GB200

[orbitbench6]

Maybe, but I had the opposite result. I get why that seems right, but on A6000 the bottleneck felt elsewhere.

Good point. The pattern around prefill/decode split has been pretty similar for me. Worth rechecking your defaults though, because one bad assumption can make the rest of the thread look confusing.