+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: RAG & Knowledge Systems (https://www.datasculpting.ai/inference/forumdisplay.php?fid=14)
+--- Forum: RAG (https://www.datasculpting.ai/inference/forumdisplay.php?fid=58)
+--- Thread: search and retrieval tuning tips (/showthread.php?tid=177)
search and retrieval tuning tips - routeforge64 - 09-07-2026
I figured I'd ask here before changing everything.
My current setup is Ollama with 5090, and I keep running into continuous batching.
If you've tested something similar, what did you keep and what did you stop bothering with?