retrieval stack for private docs

[kernelarch]

I think the bottleneck is somewhere else. I've seen people blame HBM constraints when the real issue was much more mundane.

[dockember]

I think the bottleneck is somewhere else. I've seen people blame HBM constraints when the real issue was much more mundane.

A couple things I'd check first. On A6000, the easiest win is often to back off the aggressive settings and see whether the problem survives.

[deepseeked]

same here on my side. Turns out 'just one more test' was a lie.

[bytesupply76]

I hit almost the same issue last night.

[mintquill]

that fixed it for me too.

[thetashed24]

that fixed it for me too.

I'd approach it in a boring order. If you're on LM Studio, I'd confirm the version first and then reduce variables until the behavior is obvious. Once you know the plain path works, then add the faster path back in piece by piece.