+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: RAG & Knowledge Systems (https://www.datasculpting.ai/inference/forumdisplay.php?fid=14)
+--- Forum: Search / Retrieval / Reranking (https://www.datasculpting.ai/inference/forumdisplay.php?fid=61)
+--- Thread: Search / Retrieval / Reranking discussion with Ollama (/showthread.php?tid=143)
Pages:
1
2
Re: Search / Retrieval / Reranking discussion with Ollama - syshouse - 09-11-2026
subscribed, curious where this lands.
Re: Search / Retrieval / Reranking discussion with Ollama - cobaltworks25 - 09-11-2026
following this because I'm in the same boat.
If you post your exact settings, people here can probably narrow it down pretty fast.
Re: Search / Retrieval / Reranking discussion with Ollama - thetaarch43 - 09-11-2026
A couple things I'd check first. Before rebuilding anything, I'd test one clean baseline with Mixtral and compare from there.
Re: Search / Retrieval / Reranking discussion with Ollama - cudapoint - 09-11-2026
Tried to reproduce it just now. I couldn't reproduce the slowdown until I pushed context much higher. I expected the model choice to matter more than it did.