10-18-2026, 07:06 PM
Tried to reproduce it just now. On mini PC with SGLang, I saw basically the same behavior. The surprise was that memory pressure showed up before throughput collapsed.
I'm happy to test one more variant if you want a second data point.
I'm happy to test one more variant if you want a second data point.
