Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Search / Retrieval / Reranking discussion with Ollama
#7
I don't think that's the whole story. I get why that seems right, but on 5090 the bottleneck felt elsewhere. Could be a workload difference, but I wouldn't generalize too fast from one setup.

There are a few different conversations hiding inside this thread, so being explicit about the goal helps. At this point the real bottleneck is my patience.
serving stack tinkerer
Reply


Messages In This Thread
Re: Search / Retrieval / Reranking discussion with Ollama - by audioforge - 09-10-2026, 08:23 AM

Forum Jump:


Users browsing this thread: 1 Guest(s)