+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Training & Customization (https://www.datasculpting.ai/inference/forumdisplay.php?fid=13)
+--- Forum: Distillation (https://www.datasculpting.ai/inference/forumdisplay.php?fid=55)
+--- Thread: RAG recall vs speed tradeoff: early impressions (/showthread.php?tid=1247)
RAG recall vs speed tradeoff: early impressions - bytegarden73 - 10-14-2026
Posting this in case it saves someone else a little time.
I'm not trying to build a perfect architecture diagram. I just want a sane starting point around SGLang and 7900 XTX.
Would rather learn from your scars than collect my own all at once.
Re: RAG recall vs speed tradeoff: early impressions - llmtrack - 10-16-2026
I hit almost the same issue last night.