Tensor cores actually helping here

[audioriver]

I'd approach it in a boring order. Start by verifying the driver/runtime combo, then test with a smaller prompt, then look at workstation thermals. A lot of these threads end up being one bad config plus a pile of conclusions drawn from it.

[cobaltspark]

What exact setup are you running? What model, what runtime, and roughly what context size?

[kernelmike]

worth checking the driver first.