Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
RAG recall vs speed tradeoff for Phi
#8
Quote:My first guess would be this: Before rebuilding anything, I'd test one clean baseline with Gemma and compare from there. Not glamorous advice, but rep

What worked for me was pretty simple. If you're on Ollama, I'd confirm the version first and then reduce variables until the behavior is obvious.
trying not to rebuild again
Reply


Messages In This Thread
Re: RAG recall vs speed tradeoff for Phi - by phaseshed - 10-07-2026, 12:26 AM

Forum Jump:


Users browsing this thread: 1 Guest(s)