+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Training & Customization (https://www.datasculpting.ai/inference/forumdisplay.php?fid=13)
+--- Forum: Distillation (https://www.datasculpting.ai/inference/forumdisplay.php?fid=55)
+--- Thread: RAG recall vs speed tradeoff for Phi (/showthread.php?tid=746)
Pages:
1
2
Re: RAG recall vs speed tradeoff for Phi - vrampilot - 10-07-2026
Tried to reproduce it just now. My result was mixed: first run looked bad, second run looked normal. The main thing that moved was latency, not quality.
Re: RAG recall vs speed tradeoff for Phi - tensorkite - 10-07-2026
Did a small comparison this afternoon. On 4090 with SGLang, I saw basically the same behavior.