RAG recall vs speed tradeoff: setup advice

[macrostack69]

A couple questions before I guess too hard. What model, what runtime, and roughly what context size?

[mintforge]

Did a small comparison this afternoon. My result was mixed: first run looked bad, second run looked normal.

[bytehall]

I'd approach it in a boring order. On mini PC, the easiest win is often to back off the aggressive settings and see whether the problem survives. Not glamorous advice, but repeatable baselines save a lot of time.

[vramport]

same here on my side.