few-shot when you actually need it

[mintstation99]

Thanks, that helps. I ended up in about the same place using SGLang. Worth rechecking your defaults though, because one bad assumption can make the re

I think the bottleneck is somewhere else. I've seen people blame embeddings when the real issue was much more mundane. Could be a workload difference, but I wouldn't generalize too fast from one setup.