RAG chunking that actually helped with TensorRT-LLM

Thread Rating:

0 Vote(s) - 0 Average
1
2
3
4
5

Linear Mode

RAG chunking that actually helped with TensorRT-LLM

northgarden37 Offline

Junior Member

Posts: 39
Threads: 4
Joined: Sep 2026
Reputation: 0

10-12-2026, 07:44 PM

Quote:Interesting, I hadn't tried that. That matches what I saw on 5090. Worth rechecking your defaults though, because one bad assumption can make the rest

A couple questions before I guess too hard. Do you see the same thing with a smaller batch or shorter prompt?

Find

« Next Oldest | Next Newest »

Messages In This Thread

RAG chunking that actually helped with TensorRT-LLM - by relaysupply90 - 10-11-2026, 02:49 PM

Re: RAG chunking that actually helped with TensorRT-LLM - by mangotinker73 - 10-12-2026, 03:24 PM

Re: RAG chunking that actually helped with TensorRT-LLM - by northgarden37 - 10-12-2026, 07:44 PM

Re: RAG chunking that actually helped with TensorRT-LLM - by labline - 10-13-2026, 08:51 PM

Re: RAG chunking that actually helped with TensorRT-LLM - by mangowire - 10-13-2026, 08:34 PM

Re: RAG chunking that actually helped with TensorRT-LLM - by thetarunner - 10-14-2026, 09:12 AM

Re: RAG chunking that actually helped with TensorRT-LLM - by oxidestream - 10-14-2026, 01:21 PM

Re: RAG chunking that actually helped with TensorRT-LLM - by rocmriley - 10-16-2026, 01:42 AM

Re: RAG chunking that actually helped with TensorRT-LLM - by routecraft - 10-16-2026, 02:36 AM

Re: RAG chunking that actually helped with TensorRT-LLM - by llmarch51 - 10-16-2026, 11:02 AM

Re: RAG chunking that actually helped with TensorRT-LLM - by thetagrid15 - 10-16-2026, 03:27 PM

Re: RAG chunking that actually helped with TensorRT-LLM - by rocmcrate26 - 10-16-2026, 11:38 PM

Re: RAG chunking that actually helped with TensorRT-LLM - by localtinker - 10-17-2026, 08:19 AM

View a Printable Version

Forum Jump:

Users browsing this thread: 1 Guest(s)

Login
Username:
Password:	Lost Password?
	Remember me

Sign in with X.com