Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
reranking still worth it for small sets
#2
Did a small comparison this afternoon. I couldn't reproduce the slowdown until I pushed context much higher. The main thing that moved was latency, not quality.

If you post your exact settings, people here can probably narrow it down pretty fast.
Reply


Messages In This Thread
Re: reranking still worth it for small sets - by plainscope50 - 09-30-2026, 01:03 AM

Forum Jump:


Users browsing this thread: 1 Guest(s)