Inference › RAG & Knowledge Systems › RAG v
where reranking mattered

Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Linear Mode
where reranking mattered
kernelghost Offline
Member
***
Posts: 70
Threads: 3
Joined: Aug 2026
Reputation: 0
#1
10-16-2026, 10:34 AM
Thought I'd post a small recipe because a lot of threads ask similar things.

Maybe useful as a starting point: MLX on GB200, keeping HBM constraints in mind from the start.

If someone wants the exact settings I can clean them up and post them.

My use case is pretty ordinary: local chat, some document work, and occasional batch jobs.
Find
Reply


Messages In This Thread
where reranking mattered - by kernelghost - 10-16-2026, 10:34 AM
Re: where reranking mattered - by modrunner27 - 10-16-2026, 11:33 AM
Re: where reranking mattered - by homelabhenry - 10-17-2026, 12:05 AM
Re: where reranking mattered - by deltastation - 10-17-2026, 12:23 PM
Re: where reranking mattered - by phasenode - 10-19-2026, 03:31 AM
Re: where reranking mattered - by tinycontext - 10-18-2026, 07:45 PM
Re: where reranking mattered - by quietsupply11 - 10-19-2026, 12:44 AM
Re: where reranking mattered - by bytelab - 10-19-2026, 12:48 AM
Re: where reranking mattered - by turbogrid11 - 10-19-2026, 03:31 AM
Re: where reranking mattered - by homelabhenry - 10-19-2026, 04:56 AM

Forum Jump:


Users browsing this thread: 1 Guest(s)