Inference
Search / Retrieval / Reranking discussion on A6000 - Printable Version

+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: RAG & Knowledge Systems (https://www.datasculpting.ai/inference/forumdisplay.php?fid=14)
+--- Forum: Search / Retrieval / Reranking (https://www.datasculpting.ai/inference/forumdisplay.php?fid=61)
+--- Thread: Search / Retrieval / Reranking discussion on A6000 (/showthread.php?tid=333)

Pages: 1 2


Re: Search / Retrieval / Reranking discussion on A6000 - cozykite - 09-21-2026

I don't think that's the whole story. I've seen people blame KV cache pressure when the real issue was much more mundane. Not saying you're wrong, just that I wouldn't lock that in as the lesson yet.