RAG recall vs speed tradeoff on Threadripper box

Thread Rating:

0 Vote(s) - 0 Average
1
2
3
4
5

Linear Mode

RAG recall vs speed tradeoff on Threadripper box

llm_wren Offline

Member

Posts: 85
Threads: 12
Joined: Aug 2026
Reputation: 0

#11

10-02-2026, 07:59 PM

Quote:Can you fill in a bit more context? Do you see the same thing with a smaller batch or shorter prompt?

Appreciate the detail. I don't think your conclusion is far off. Worth rechecking your defaults though, because one bad assumption can make the rest of the thread look confusing.

LoRA tinkerer • dataset janitor

Find

« Next Oldest | Next Newest »

Messages In This Thread

RAG recall vs speed tradeoff on Threadripper box - by mintquill - 09-27-2026, 05:15 AM

Re: RAG recall vs speed tradeoff on Threadripper box - by quietsupply11 - 09-27-2026, 06:33 AM

Re: RAG recall vs speed tradeoff on Threadripper box - by cobaltworks25 - 09-30-2026, 08:43 PM

Re: RAG recall vs speed tradeoff on Threadripper box - by cacheworks - 09-30-2026, 07:15 AM

Re: RAG recall vs speed tradeoff on Threadripper box - by bytestack - 09-30-2026, 11:41 AM

Re: RAG recall vs speed tradeoff on Threadripper box - by torchtrack24 - 09-30-2026, 09:52 PM

Re: RAG recall vs speed tradeoff on Threadripper box - by macrolab - 09-30-2026, 12:09 PM

Re: RAG recall vs speed tradeoff on Threadripper box - by bytesupply76 - 09-30-2026, 09:22 PM

Re: RAG recall vs speed tradeoff on Threadripper box - by mangotinker73 - 10-02-2026, 09:56 AM

Re: RAG recall vs speed tradeoff on Threadripper box - by localpatch78 - 10-02-2026, 11:32 AM

Re: RAG recall vs speed tradeoff on Threadripper box - by llm_wren - 10-02-2026, 07:59 PM

Re: RAG recall vs speed tradeoff on Threadripper box - by turboarch95 - 10-03-2026, 08:08 PM

View a Printable Version

Forum Jump:

Users browsing this thread: 1 Guest(s)

Login
Username:
Password:	Lost Password?
	Remember me

Sign in with X.com