what music do you benchmark to: setup advice

[deltapoint17]

This keeps coming up in conversation so I figured I'd start a thread.

One thing I keep noticing is that people underestimate tokens/sec until they actually try to run this stuff for more than one afternoon.

Curious whether that lines up with what other people are seeing.

[labpath]

Thanks, that helps. The pattern around long context has been pretty similar for me.

[sanepeak48]

What worked for me was pretty simple. On B200, the easiest win is often to back off the aggressive settings and see whether the problem survives. A lot of these threads end up being one bad config plus a pile of conclusions drawn from it.