09-05-2026, 11:33 AM
Quote:I'd start with the simpler stack.
Interesting, I hadn't tried that. The pattern around continuous batching has been pretty similar for me. Worth rechecking your defaults though, because one bad assumption can make the rest of the thread look confusing.
I'm happy to test one more variant if you want a second data point.