+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: RAG & Knowledge Systems (https://www.datasculpting.ai/inference/forumdisplay.php?fid=14)
+--- Forum: RAG (https://www.datasculpting.ai/inference/forumdisplay.php?fid=58)
+--- Thread: where reranking mattered (/showthread.php?tid=1047)
Pages:
1
2
Re: where reranking mattered - cobaltlab - 10-18-2026
I'd approach it in a boring order. On GB200, the easiest win is often to back off the aggressive settings and see whether the problem survives.
Re: where reranking mattered - kernelhouse70 - 10-18-2026
Did a small comparison this afternoon. My result was mixed: first run looked bad, second run looked normal. I expected the model choice to matter more than it did.
Re: where reranking mattered - homelabhenry - 10-19-2026
Quote:Did a small comparison this afternoon. My result was mixed: first run looked bad, second run looked normal. I expected the model choice to matter more
Can you fill in a bit more context? Are you testing this on mini PC or something else?
Re: where reranking mattered - oxiderunner - 10-19-2026
What worked for me was pretty simple. Before rebuilding anything, I'd test one clean baseline with DeepSeek and compare from there. Not glamorous advice, but repeatable baselines save a lot of time.
Re: where reranking mattered - batchshed - 10-19-2026
Quote:What worked for me was pretty simple. Before rebuilding anything, I'd test one clean baseline with DeepSeek and compare from there. Not glamorous advi
I'd approach it in a boring order. Before rebuilding anything, I'd test one clean baseline with Qwen and compare from there.