Inference
retrieval stack for private docs - Printable Version

+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Training & Customization (https://www.datasculpting.ai/inference/forumdisplay.php?fid=13)
+--- Forum: Distillation (https://www.datasculpting.ai/inference/forumdisplay.php?fid=55)
+--- Thread: retrieval stack for private docs (/showthread.php?tid=1298)



retrieval stack for private docs - deltapoint17 - 10-15-2026

Posting this in case it saves someone else a little time.

I'm not trying to build a perfect architecture diagram. I just want a sane starting point around vLLM and GB200.

I'm especially interested in mistakes worth avoiding.