RAG recall vs speed tradeoff: setup advice

[byteyard]

Thanks, that helps. I ended up in about the same place using LM Studio. Worth rechecking your defaults though, because one bad assumption can make the

Good point. The pattern around batch size has been pretty similar for me.