10-17-2026, 06:45 AM
I tested this tonight. I couldn't reproduce the slowdown until I pushed context much higher. The surprise was that memory pressure showed up before throughput collapsed.
|
vLLM vs SGLang for small teams on dual 3090
|
|
« Next Oldest | Next Newest »
|