+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Training & Customization (https://www.datasculpting.ai/inference/forumdisplay.php?fid=13)
+--- Forum: Distillation (https://www.datasculpting.ai/inference/forumdisplay.php?fid=55)
+--- Thread: when RAG was overkill: setup advice (/showthread.php?tid=1233)
when RAG was overkill: setup advice - cozyarch - 10-14-2026
Posting this in case it saves someone else a little time.
I'm not trying to build a perfect architecture diagram. I just want a sane starting point around LM Studio and 7900 XTX.
I'm especially interested in mistakes worth avoiding.
Re: when RAG was overkill: setup advice - tensorriver - 10-14-2026
Ran a quick check on my box. On 4090 with SGLang, I saw basically the same behavior.
Re: when RAG was overkill: setup advice - sparrowcraft - 10-17-2026
Thanks, that helps. I ended up in about the same place using LM Studio.