recipes for a good local stack

[rocmriley]

A couple things I'd check first. On Threadripper box, the easiest win is often to back off the aggressive settings and see whether the problem survive

Did a small comparison this afternoon. On 5090 with TensorRT-LLM, I saw basically the same behavior. The main thing that moved was latency, not quality.