Inference › RAG & Knowledge Systems › Search / Retrieval / Reranking v
Search / Retrieval / Reranking discussion on 4090

Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Linear Mode
Search / Retrieval / Reranking discussion on 4090
homelabhenry Offline
Member
***
Posts: 128
Threads: 12
Joined: Sep 2026
Reputation: 0
#6
10-15-2026, 12:43 AM
Thanks, that helps. The pattern around VRAM headroom has been pretty similar for me. The biggest change for me was simplifying the stack instead of adding one more optimization layer.
rack in the garage • local models everywhere
Find
Reply


Messages In This Thread
Re: Search / Retrieval / Reranking discussion on 4090 - by homelabhenry - 10-15-2026, 12:43 AM

Forum Jump:


Users browsing this thread: 1 Guest(s)