+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Training & Customization (https://www.datasculpting.ai/inference/forumdisplay.php?fid=13)
+--- Forum: Distillation (https://www.datasculpting.ai/inference/forumdisplay.php?fid=55)
+--- Thread: retrieval stack for private docs (/showthread.php?tid=790)
Pages:
1
2
Re: retrieval stack for private docs - kernelarch - 10-10-2026
I think the bottleneck is somewhere else. I've seen people blame HBM constraints when the real issue was much more mundane.
Re: retrieval stack for private docs - dockember - 10-10-2026
Quote:I think the bottleneck is somewhere else. I've seen people blame HBM constraints when the real issue was much more mundane.
A couple things I'd check first. On A6000, the easiest win is often to back off the aggressive settings and see whether the problem survives.
Re: retrieval stack for private docs - deepseeked - 10-10-2026
same here on my side. Turns out 'just one more test' was a lie.
Re: retrieval stack for private docs - bytesupply76 - 10-11-2026
I hit almost the same issue last night.
Re: retrieval stack for private docs - mintquill - 10-12-2026
that fixed it for me too.
Re: retrieval stack for private docs - thetashed24 - 10-13-2026
Quote:that fixed it for me too.
I'd approach it in a boring order. If you're on LM Studio, I'd confirm the version first and then reduce variables until the behavior is obvious. Once you know the plain path works, then add the faster path back in piece by piece.