vLLM vs SGLang for small teams

[thetaplane]

A couple things I'd check first. On dual 3090, the easiest win is often to back off the aggressive settings and see whether the problem survives. A lo

Good point. The pattern around reranking has been pretty similar for me. Worth rechecking your defaults though, because one bad assumption can make the rest of the thread look confusing.