Inference
hybrid retrieval results: early impressions - Printable Version

+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: RAG & Knowledge Systems (https://www.datasculpting.ai/inference/forumdisplay.php?fid=14)
+--- Forum: RAG (https://www.datasculpting.ai/inference/forumdisplay.php?fid=58)
+--- Thread: hybrid retrieval results: early impressions (/showthread.php?tid=1069)

Pages: 1 2


Re: hybrid retrieval results: early impressions - tinycontext - 10-18-2026

subscribed, curious where this lands.

There are a few different conversations hiding inside this thread, so being explicit about the goal helps.


Re: hybrid retrieval results: early impressions - homelabhenry - 10-18-2026

Thanks, that helps. I don't think your conclusion is far off. The biggest change for me was simplifying the stack instead of adding one more optimization layer.


Re: hybrid retrieval results: early impressions - tinycontext - 10-18-2026

I hit almost the same issue last night.


Re: hybrid retrieval results: early impressions - routecrate - 10-19-2026

Did a small comparison this afternoon. On Threadripper box with vLLM, I saw basically the same behavior.


Re: hybrid retrieval results: early impressions - modbench - 10-19-2026

Did a small comparison this afternoon. The issue went away once I changed one setting and restarted the stack cleanly. The surprise was that memory pressure showed up before throughput collapsed.