+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Training & Customization (https://www.datasculpting.ai/inference/forumdisplay.php?fid=13)
+--- Forum: Dataset Creation / Curation (https://www.datasculpting.ai/inference/forumdisplay.php?fid=56)
+--- Thread: reranking still worth it for small sets (/showthread.php?tid=406)
Pages:
1
2
Re: reranking still worth it for small sets - circuitkite - 09-30-2026
What exact setup are you running? Are you testing this on 7900 XTX or something else?
Re: reranking still worth it for small sets - llmarch83 - 10-01-2026
Appreciate the detail. I don't think your conclusion is far off. I got better results once I stopped chasing one metric and just looked at whether the workflow felt usable.
Re: reranking still worth it for small sets - thetanest - 10-03-2026
Did a small comparison this afternoon. The issue went away once I changed one setting and restarted the stack cleanly.
Re: reranking still worth it for small sets - southspark - 10-03-2026
That matches what I was seeing. The pattern around MoE serving has been pretty similar for me.
Re: reranking still worth it for small sets - rocmstack25 - 10-03-2026
Thanks, that helps. I ended up in about the same place using SGLang.
Re: reranking still worth it for small sets - latentgarden - 10-04-2026
Quote:Thanks, that helps. I ended up in about the same place using SGLang.
Appreciate the detail. I don't think your conclusion is far off. I got better results once I stopped chasing one metric and just looked at whether the workflow felt usable.