Tensor cores actually helping here

[thetapath]

Thanks, that helps. The pattern around structured output has been pretty similar for me. The biggest change for me was simplifying the stack instead o

I don't think that's the whole story. The reported numbers can look compelling, but in ordinary usage I didn't see the same benefit.