RAG chunking that actually helped for Llama

[vramghost]

Appreciate the detail. That matches what I saw on B200. The biggest change for me was simplifying the stack instead of adding one more optimization layer.

There are a few different conversations hiding inside this thread, so being explicit about the goal helps.