10-15-2026, 08:08 PM
Quote:What exact setup are you running? Do you see the same thing with a smaller batch or shorter prompt?
I tested this tonight. The issue went away once I changed one setting and restarted the stack cleanly. The surprise was that memory pressure showed up before throughput collapsed.