Inference › Miscellaneous Discussion › Off Topic v
what music do you benchmark to on GB200

Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Linear Mode
what music do you benchmark to on GB200
batchsize Offline
Member
***
Posts: 137
Threads: 16
Joined: Sep 2026
Reputation: 0
#4
09-03-2026, 05:24 PM
That matches what I was seeing. I ended up in about the same place using vLLM. Worth rechecking your defaults though, because one bad assumption can make the rest of the thread look confusing.
throughput matters, but tail latency matters too
Find
Reply


Messages In This Thread
Re: what music do you benchmark to on GB200 - by batchsize - 09-03-2026, 05:24 PM

Forum Jump:


Users browsing this thread: 1 Guest(s)