+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: RAG & Knowledge Systems (https://www.datasculpting.ai/inference/forumdisplay.php?fid=14)
+--- Forum: RAG (https://www.datasculpting.ai/inference/forumdisplay.php?fid=58)
+--- Thread: where reranking mattered: what are you seeing? (/showthread.php?tid=1177)
Pages:
1
2
Re: where reranking mattered: what are you seeing? - modbench - 10-18-2026
That matches what I was seeing. I don't think your conclusion is far off. Worth rechecking your defaults though, because one bad assumption can make the rest of the thread look confusing.
Re: where reranking mattered: what are you seeing? - benchplease - 10-18-2026
Tried to reproduce it just now. I couldn't reproduce the slowdown until I pushed context much higher.
Re: where reranking mattered: what are you seeing? - cobaltlab - 10-19-2026
Not sure I agree there. I get why that seems right, but on Threadripper box the bottleneck felt elsewhere.