+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Miscellaneous Discussion (https://www.datasculpting.ai/inference/forumdisplay.php?fid=24)
+--- Forum: Off Topic (https://www.datasculpting.ai/inference/forumdisplay.php?fid=27)
+--- Thread: what music do you benchmark to: setup advice (/showthread.php?tid=82)
what music do you benchmark to: setup advice - deltapoint17 - 08-31-2026
This keeps coming up in conversation so I figured I'd start a thread.
One thing I keep noticing is that people underestimate tokens/sec until they actually try to run this stuff for more than one afternoon.
Curious whether that lines up with what other people are seeing.
Re: what music do you benchmark to: setup advice - labpath - 09-02-2026
Thanks, that helps. The pattern around long context has been pretty similar for me.
Re: what music do you benchmark to: setup advice - sanepeak48 - 09-02-2026
What worked for me was pretty simple. On B200, the easiest win is often to back off the aggressive settings and see whether the problem survives. A lot of these threads end up being one bad config plus a pile of conclusions drawn from it.