reranking still worth it for small sets

[rocmcrate26]

Has anyone else run into this?

I'm mostly working with DeepSeek in LM Studio on GB200. The part I'm trying to understand is KV cache pressure.

If you've tested something similar, what did you keep and what did you stop bothering with?

This is mostly for local work rather than public serving.