RAG chunking that actually helped on Threadripper box

Thread Rating:

0 Vote(s) - 0 Average
1
2
3
4
5

Linear Mode

RAG chunking that actually helped on Threadripper box

kernelmike Offline

Member

Posts: 184
Threads: 23
Joined: Sep 2026
Reputation: 0

10-12-2026, 05:22 PM

Appreciate the detail. I ended up in about the same place using SGLang. The biggest change for me was simplifying the stack instead of adding one more optimization layer.

Mostly CUDA, sometimes wrong, usually measured

Find

« Next Oldest | Next Newest »

Messages In This Thread

RAG chunking that actually helped on Threadripper box - by pixelspark - 10-10-2026, 04:58 PM

Re: RAG chunking that actually helped on Threadripper box - by kernelmike - 10-12-2026, 05:22 PM

Re: RAG chunking that actually helped on Threadripper box - by plainline - 10-12-2026, 06:08 PM

Re: RAG chunking that actually helped on Threadripper box - by torchdesk - 10-12-2026, 06:46 PM

Re: RAG chunking that actually helped on Threadripper box - by latentgarden - 10-12-2026, 08:01 PM

Re: RAG chunking that actually helped on Threadripper box - by vectorpoint - 10-12-2026, 08:11 PM

Re: RAG chunking that actually helped on Threadripper box - by visionyard23 - 10-12-2026, 08:35 PM

Re: RAG chunking that actually helped on Threadripper box - by rocmpath - 10-12-2026, 09:16 PM

Re: RAG chunking that actually helped on Threadripper box - by localcraft17 - 10-13-2026, 09:54 AM

Re: RAG chunking that actually helped on Threadripper box - by thetanest - 10-13-2026, 06:07 PM

Re: RAG chunking that actually helped on Threadripper box - by tensorriver - 10-15-2026, 06:16 AM

Re: RAG chunking that actually helped on Threadripper box - by mangopath4 - 10-15-2026, 02:49 PM

Re: RAG chunking that actually helped on Threadripper box - by byteyard - 10-15-2026, 05:19 PM

Re: RAG chunking that actually helped on Threadripper box - by phaseport36 - 10-17-2026, 05:19 AM

Re: RAG chunking that actually helped on Threadripper box - by thetaplane - 10-17-2026, 07:37 AM

Re: RAG chunking that actually helped on Threadripper box - by orbitline - 10-18-2026, 07:43 AM

View a Printable Version

Forum Jump:

Users browsing this thread: 1 Guest(s)

Login
Username:
Password:	Lost Password?
	Remember me

Sign in with X.com