RAG chunking that actually helped on Threadripper box

Thread Rating:

0 Vote(s) - 0 Average
1
2
3
4
5

Linear Mode

RAG chunking that actually helped on Threadripper box

thetaplane Offline

Offline

Junior Member

Posts: 33
Threads: 7
Joined: Sep 2026
Reputation: 0

#15

10-17-2026, 07:37 AM

Not sure I agree there. I wouldn't optimize around that first. On my side the bigger swing came from the runtime and not the model. Not saying you're wrong, just that I wouldn't lock that in as the lesson yet. The logs were somehow calmer than I was.

Find

Reply

« Next Oldest | Next Newest »

Messages In This Thread

RAG chunking that actually helped on Threadripper box - by pixelspark - 10-10-2026, 04:58 PM

Re: RAG chunking that actually helped on Threadripper box - by kernelmike - 10-12-2026, 05:22 PM

Re: RAG chunking that actually helped on Threadripper box - by plainline - 10-12-2026, 06:08 PM

Re: RAG chunking that actually helped on Threadripper box - by torchdesk - 10-12-2026, 06:46 PM

Re: RAG chunking that actually helped on Threadripper box - by latentgarden - 10-12-2026, 08:01 PM

Re: RAG chunking that actually helped on Threadripper box - by vectorpoint - 10-12-2026, 08:11 PM

Re: RAG chunking that actually helped on Threadripper box - by visionyard23 - 10-12-2026, 08:35 PM

Re: RAG chunking that actually helped on Threadripper box - by rocmpath - 10-12-2026, 09:16 PM

Re: RAG chunking that actually helped on Threadripper box - by localcraft17 - 10-13-2026, 09:54 AM

Re: RAG chunking that actually helped on Threadripper box - by thetanest - 10-13-2026, 06:07 PM

Re: RAG chunking that actually helped on Threadripper box - by tensorriver - 10-15-2026, 06:16 AM

Re: RAG chunking that actually helped on Threadripper box - by mangopath4 - 10-15-2026, 02:49 PM

Re: RAG chunking that actually helped on Threadripper box - by byteyard - 10-15-2026, 05:19 PM

Re: RAG chunking that actually helped on Threadripper box - by phaseport36 - 10-17-2026, 05:19 AM

Re: RAG chunking that actually helped on Threadripper box - by thetaplane - 10-17-2026, 07:37 AM

Re: RAG chunking that actually helped on Threadripper box - by orbitline - 10-18-2026, 07:43 AM

View a Printable Version

Forum Jump:

Users browsing this thread: 2 Guest(s)