09-24-2026, 07:56 PM
This keeps coming up in conversation so I figured I'd start a thread.
The more I work with local setups, the more it seems like HBM constraints decides everything downstream.
Wondering if this is just where the whole space is heading now.
I care more about stability than squeezing the last possible tokens/sec out of it.
The more I work with local setups, the more it seems like HBM constraints decides everything downstream.
Wondering if this is just where the whole space is heading now.
I care more about stability than squeezing the last possible tokens/sec out of it.