RAG recall vs speed tradeoff on Threadripper box

Thread Rating:

0 Vote(s) - 0 Average
1
2
3
4
5

Linear Mode

RAG recall vs speed tradeoff on Threadripper box

bytestack Offline

Offline

Member

Posts: 50
Threads: 3
Joined: Sep 2026
Reputation: 0

#4

09-30-2026, 11:41 AM

I think the bottleneck is somewhere else. I get why that seems right, but on 4090 the bottleneck felt elsewhere.

Find

Reply

« Next Oldest | Next Newest »

Messages In This Thread

RAG recall vs speed tradeoff on Threadripper box - by mintquill - 09-27-2026, 05:15 AM

Re: RAG recall vs speed tradeoff on Threadripper box - by quietsupply11 - 09-27-2026, 06:33 AM

Re: RAG recall vs speed tradeoff on Threadripper box - by cobaltworks25 - 09-30-2026, 08:43 PM

Re: RAG recall vs speed tradeoff on Threadripper box - by cacheworks - 09-30-2026, 07:15 AM

Re: RAG recall vs speed tradeoff on Threadripper box - by bytestack - 09-30-2026, 11:41 AM

Re: RAG recall vs speed tradeoff on Threadripper box - by torchtrack24 - 09-30-2026, 09:52 PM

Re: RAG recall vs speed tradeoff on Threadripper box - by macrolab - 09-30-2026, 12:09 PM

Re: RAG recall vs speed tradeoff on Threadripper box - by bytesupply76 - 09-30-2026, 09:22 PM

Re: RAG recall vs speed tradeoff on Threadripper box - by mangotinker73 - 10-02-2026, 09:56 AM

Re: RAG recall vs speed tradeoff on Threadripper box - by localpatch78 - 10-02-2026, 11:32 AM

Re: RAG recall vs speed tradeoff on Threadripper box - by llm_wren - 10-02-2026, 07:59 PM

Re: RAG recall vs speed tradeoff on Threadripper box - by turboarch95 - 10-03-2026, 08:08 PM

View a Printable Version

Forum Jump:

Users browsing this thread: 1 Guest(s)