Inference
where reranking mattered for Mistral - Printable Version

+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: RAG & Knowledge Systems (https://www.datasculpting.ai/inference/forumdisplay.php?fid=14)
+--- Forum: RAG (https://www.datasculpting.ai/inference/forumdisplay.php?fid=58)
+--- Thread: where reranking mattered for Mistral (/showthread.php?tid=90)

Pages: 1 2


Re: where reranking mattered for Mistral - quietarch - 09-02-2026

Not sure I agree there. The reported numbers can look compelling, but in ordinary usage I didn't see the same benefit.


Re: where reranking mattered for Mistral - orbitgarden - 09-02-2026

What exact setup are you running? Do you see the same thing with a smaller batch or shorter prompt?


Re: where reranking mattered for Mistral - kernelghost - 09-02-2026

Tried to reproduce it just now. My result was mixed: first run looked bad, second run looked normal. The main thing that moved was latency, not quality.