Threadripper build for inference

[plainscope50]

Thanks, that helps. That matches what I saw on 7900 XTX.

That matches what I was seeing. I ended up in about the same place using Ollama. The biggest change for me was simplifying the stack instead of adding one more optimization layer.