![]() |
|
hybrid retrieval results: early impressions - Printable Version +- Inference (https://www.datasculpting.ai/inference) +-- Forum: RAG & Knowledge Systems (https://www.datasculpting.ai/inference/forumdisplay.php?fid=14) +--- Forum: RAG (https://www.datasculpting.ai/inference/forumdisplay.php?fid=58) +--- Thread: hybrid retrieval results: early impressions (/showthread.php?tid=1069) Pages:
1
2
|
Re: hybrid retrieval results: early impressions - tinycontext - 10-18-2026 subscribed, curious where this lands. There are a few different conversations hiding inside this thread, so being explicit about the goal helps. Re: hybrid retrieval results: early impressions - homelabhenry - 10-18-2026 Thanks, that helps. I don't think your conclusion is far off. The biggest change for me was simplifying the stack instead of adding one more optimization layer. Re: hybrid retrieval results: early impressions - tinycontext - 10-18-2026 I hit almost the same issue last night. Re: hybrid retrieval results: early impressions - routecrate - 10-19-2026 Did a small comparison this afternoon. On Threadripper box with vLLM, I saw basically the same behavior. Re: hybrid retrieval results: early impressions - modbench - 10-19-2026 Did a small comparison this afternoon. The issue went away once I changed one setting and restarted the stack cleanly. The surprise was that memory pressure showed up before throughput collapsed. |