10-10-2026, 01:28 AM
Spent some time on this today and wanted to compare notes.
I'm comparing two approaches here: keep it simple on GB200, or squeeze more out of the stack and deal with the complexity.
What would you pick if you had to live with it for a few months?
I care more about stability than squeezing the last possible tokens/sec out of it.
I'm comparing two approaches here: keep it simple on GB200, or squeeze more out of the stack and deal with the complexity.
What would you pick if you had to live with it for a few months?
I care more about stability than squeezing the last possible tokens/sec out of it.