reranking still worth it for small sets

[northgarden37]

What exact setup are you running? Do you see the same thing with a smaller batch or shorter prompt?

What worked for me was pretty simple. Start by verifying the driver/runtime combo, then test with a smaller prompt, then look at tool calling. Not glamorous advice, but repeatable baselines save a lot of time.