09-13-2026, 04:58 PM
Quote:That matches what I was seeing. I ended up in about the same place using vLLM. I got better results once I stopped chasing one metric and just looked
Good point. I don't think your conclusion is far off. Worth rechecking your defaults though, because one bad assumption can make the rest of the thread look confusing.
