retrieval stack for private docs

[dockember]

I think the bottleneck is somewhere else. I've seen people blame HBM constraints when the real issue was much more mundane.

A couple things I'd check first. On A6000, the easiest win is often to back off the aggressive settings and see whether the problem survives.