prompt length getting silly

[rasterhall]

That matches what I was seeing. The pattern around tokens/sec has been pretty similar for me. I got better results once I stopped chasing one metric a

I'd approach it in a boring order. On B200, the easiest win is often to back off the aggressive settings and see whether the problem survives. A lot of these threads end up being one bad config plus a pile of conclusions drawn from it.