Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
TensorRT-LLM worth the setup time: early impressions
#1
I'm trying to sanity-check my setup.

I'm trying to decide whether to keep the current stack or change course. Main question is how people here are handling HBM constraints.

Not looking for the perfect answer, mostly what worked in real use.
Mostly CUDA, sometimes wrong, usually measured
Reply


Messages In This Thread
TensorRT-LLM worth the setup time: early impressions - by kernelmike - 10-04-2026, 04:18 PM

Forum Jump:


Users browsing this thread: 1 Guest(s)