Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
reranking still worth it for small sets
#1
Spent some time on this today and wanted to compare notes.

I'm comparing two approaches here: keep it simple on mini PC, or squeeze more out of the stack and deal with the complexity.

Trying to avoid rebuilding the whole thing twice.

My use case is pretty ordinary: local chat, some document work, and occasional batch jobs.
rack in the garage • local models everywhere
Reply


Messages In This Thread
reranking still worth it for small sets - by homelabhenry - 09-09-2026, 06:31 AM

Forum Jump:


Users browsing this thread: 1 Guest(s)