RAG chunking that actually helped on Threadripper box

Thread Rating:

0 Vote(s) - 0 Average
1
2
3
4
5

Linear Mode

RAG chunking that actually helped on Threadripper box

pixelspark Offline

Offline

Junior Member

Posts: 30
Threads: 4
Joined: Sep 2026
Reputation: 0

#1

10-10-2026, 04:58 PM

Thought I'd post a small recipe because a lot of threads ask similar things.

Just sharing a setup that ended up working reasonably well: Phi, Ollama, Threadripper box, with a lot of attention on quant drift.

Feel free to tear it apart if you see something dumb.

Find

Reply

« Next Oldest | Next Newest »

Messages In This Thread

RAG chunking that actually helped on Threadripper box - by pixelspark - 10-10-2026, 04:58 PM

Re: RAG chunking that actually helped on Threadripper box - by kernelmike - 10-12-2026, 05:22 PM

Re: RAG chunking that actually helped on Threadripper box - by plainline - 10-12-2026, 06:08 PM

Re: RAG chunking that actually helped on Threadripper box - by torchdesk - 10-12-2026, 06:46 PM

Re: RAG chunking that actually helped on Threadripper box - by latentgarden - 10-12-2026, 08:01 PM

Re: RAG chunking that actually helped on Threadripper box - by vectorpoint - 10-12-2026, 08:11 PM

Re: RAG chunking that actually helped on Threadripper box - by visionyard23 - 10-12-2026, 08:35 PM

Re: RAG chunking that actually helped on Threadripper box - by rocmpath - 10-12-2026, 09:16 PM

Re: RAG chunking that actually helped on Threadripper box - by localcraft17 - 10-13-2026, 09:54 AM

Re: RAG chunking that actually helped on Threadripper box - by thetanest - 10-13-2026, 06:07 PM

Re: RAG chunking that actually helped on Threadripper box - by tensorriver - 10-15-2026, 06:16 AM

Re: RAG chunking that actually helped on Threadripper box - by mangopath4 - 10-15-2026, 02:49 PM

Re: RAG chunking that actually helped on Threadripper box - by byteyard - 10-15-2026, 05:19 PM

Re: RAG chunking that actually helped on Threadripper box - by phaseport36 - 10-17-2026, 05:19 AM

Re: RAG chunking that actually helped on Threadripper box - by thetaplane - 10-17-2026, 07:37 AM

Re: RAG chunking that actually helped on Threadripper box - by orbitline - 10-18-2026, 07:43 AM

View a Printable Version

Forum Jump:

Users browsing this thread: 1 Guest(s)