+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: RAG & Knowledge Systems (https://www.datasculpting.ai/inference/forumdisplay.php?fid=14)
+--- Forum: RAG (https://www.datasculpting.ai/inference/forumdisplay.php?fid=58)
+--- Thread: hybrid retrieval results (/showthread.php?tid=854)
Pages:
1
2
Re: hybrid retrieval results - orbitgarden - 10-14-2026
My first guess would be this: On 4090, the easiest win is often to back off the aggressive settings and see whether the problem survives.
Re: hybrid retrieval results - cozykite - 10-14-2026
I hit almost the same issue last night.
Re: hybrid retrieval results - labpath - 10-14-2026
Tried to reproduce it just now. I couldn't reproduce the slowdown until I pushed context much higher.
Re: hybrid retrieval results - sanepeak48 - 10-14-2026
Did a small comparison this afternoon. The issue went away once I changed one setting and restarted the stack cleanly. The surprise was that memory pressure showed up before throughput collapsed.