Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Search / Retrieval / Reranking discussion
#1
I'm trying to sanity-check my setup.

I'm trying to decide whether to keep the current stack or change course. Main question is how people here are handling continuous batching.

Would appreciate practical advice rather than theory.

This is mostly for local work rather than public serving.
Reply


Messages In This Thread
Search / Retrieval / Reranking discussion - by signalcraft14 - 10-07-2026, 06:27 PM

Forum Jump:


Users browsing this thread: 1 Guest(s)