09-13-2026, 02:59 AM
Quote:Quote:I tested this tonight. The issue went away once I changed one setting and restarted the stack cleanly.
Interesting, I hadn't tried that. The pattern around continuous batching has been pretty similar for me. The biggest change for me was simplifying the stack instead of adding one more optimization layer.
Mostly CUDA, sometimes wrong, usually measured