Threadripper build for inference on A6000

[vectorember]

Posting this in case it saves someone else a little time.

I'm helping a small team set up a local workflow. We don't need a giant stack, but we do care about continuous batching.

Would rather learn from your scars than collect my own all at once.