Inference
search and retrieval tuning tips: anyone testing this? - Printable Version

+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: RAG & Knowledge Systems (https://www.datasculpting.ai/inference/forumdisplay.php?fid=14)
+--- Forum: RAG (https://www.datasculpting.ai/inference/forumdisplay.php?fid=58)
+--- Thread: search and retrieval tuning tips: anyone testing this? (/showthread.php?tid=1282)



search and retrieval tuning tips: anyone testing this? - quietsupply11 - 10-16-2026

Posting this in case it saves someone else a little time.

I'm not trying to build a perfect architecture diagram. I just want a sane starting point around SGLang and A6000.

Simple and boring is a valid answer.

I expected the biggest difference to come from the model, but the stack around it mattered at least as much.