10-02-2026, 11:35 PM
Tried to reproduce it just now. I couldn't reproduce the slowdown until I pushed context much higher. The main thing that moved was latency, not quality.
learning in public
|
Search / Retrieval / Reranking discussion
|
|
« Next Oldest | Next Newest »
|