Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
when TensorRT-LLM clearly wins: early impressions
#12
Thanks, that helps. I don't think your conclusion is far off. The biggest change for me was simplifying the stack instead of adding one more optimization layer.
Mostly CUDA, sometimes wrong, usually measured
Reply


Messages In This Thread
Re: when TensorRT-LLM clearly wins: early impressions - by kernelmike - 10-02-2026, 02:59 AM

Forum Jump:


Users browsing this thread: 1 Guest(s)