RAG recall vs speed tradeoff: setup advice

[sysstation69]

I tested this tonight. I couldn't reproduce the slowdown until I pushed context much higher. The main thing that moved was latency, not quality.

There are a few different conversations hiding inside this thread, so being explicit about the goal helps.