+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: RAG & Knowledge Systems (https://www.datasculpting.ai/inference/forumdisplay.php?fid=14)
+--- Forum: RAG (https://www.datasculpting.ai/inference/forumdisplay.php?fid=58)
+--- Thread: hybrid retrieval results: setup advice (/showthread.php?tid=1299)
hybrid retrieval results: setup advice - tinycontext - 10-15-2026
Curious what people here are seeing.
My current setup is LM Studio with 7900 XTX, and I keep running into NVFP4.
If you've tested something similar, what did you keep and what did you stop bothering with?
I expected the biggest difference to come from the model, but the stack around it mattered at least as much.
Re: hybrid retrieval results: setup advice - nanogarden - 10-16-2026
I don't think that's the whole story. I wouldn't optimize around that first. On my side the bigger swing came from the runtime and not the model.
Re: hybrid retrieval results: setup advice - orbitgarden - 10-17-2026
same here on my side. I keep promising myself this is the last rebuild.