10-09-2026, 06:33 PM
This keeps coming up in conversation so I figured I'd start a thread.
The more I work with local setups, the more it seems like batch size decides everything downstream.
Maybe obvious to some of you, but it clicked for me this week.
The more I work with local setups, the more it seems like batch size decides everything downstream.
Maybe obvious to some of you, but it clicked for me this week.
small models can still be good