10-17-2026, 12:25 PM
That matches what I was seeing. I ended up in about the same place using TensorRT-LLM. The biggest change for me was simplifying the stack instead of adding one more optimization layer.
There are a few different conversations hiding inside this thread, so being explicit about the goal helps.
There are a few different conversations hiding inside this thread, so being explicit about the goal helps.
