new here, what's your stack with SGLang

[plaingarden18]

I think the bottleneck is somewhere else. I wouldn't optimize around that first. On my side the bigger swing came from the runtime and not the model.