Inference
reranking still worth it for small sets: early impressions - Printable Version

+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Training & Customization (https://www.datasculpting.ai/inference/forumdisplay.php?fid=13)
+--- Forum: Dataset Creation / Curation (https://www.datasculpting.ai/inference/forumdisplay.php?fid=56)
+--- Thread: reranking still worth it for small sets: early impressions (/showthread.php?tid=219)

Pages: 1 2


Re: reranking still worth it for small sets: early impressions - fusedhall56 - 09-22-2026

I'd start with the simpler stack.


Re: reranking still worth it for small sets: early impressions - tinycontext - 09-23-2026

I tested this tonight. The issue went away once I changed one setting and restarted the stack cleanly. The surprise was that memory pressure showed up before throughput collapsed.