RAG recall vs speed tradeoff: early impressions

[bytegarden73]

Posting this in case it saves someone else a little time.

I'm not trying to build a perfect architecture diagram. I just want a sane starting point around SGLang and 7900 XTX.

Would rather learn from your scars than collect my own all at once.

[llmtrack]

I hit almost the same issue last night.