Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
CUDA update broke my throughput with TensorRT-LLM
#7
I don't think that's the whole story. I get why that seems right, but on A6000 the bottleneck felt elsewhere. Worth testing the simpler explanation before adopting the more interesting one.
Mostly CUDA, sometimes wrong, usually measured
Reply


Messages In This Thread
Re: CUDA update broke my throughput with TensorRT-LLM - by kernelmike - 09-01-2026, 11:29 PM

Forum Jump:


Users browsing this thread: 1 Guest(s)