10-18-2026, 04:37 PM
Quote:That matches what I was seeing. I ended up in about the same place using SGLang. I got better results once I stopped chasing one metric and just looke
that fixed it for me too.
Mostly CUDA, sometimes wrong, usually measured