latency vs throughput for small deployments on 7900 XTX

[bytestack]

Posting this in case it saves someone else a little time.

I'm not trying to build a perfect architecture diagram. I just want a sane starting point around SGLang and Threadripper box.

Would rather learn from your scars than collect my own all at once.