09-08-2026, 02:15 PM
Quote:Need a little more detail here. Do you see the same thing with a smaller batch or shorter prompt?
My first guess would be this: If you're on SGLang, I'd confirm the version first and then reduce variables until the behavior is obvious.
