+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Inference Engines (https://www.datasculpting.ai/inference/forumdisplay.php?fid=9)
+--- Forum: TensorRT-LLM (https://www.datasculpting.ai/inference/forumdisplay.php?fid=37)
+--- Thread: TensorRT-LLM worth the setup time (/showthread.php?tid=107)
TensorRT-LLM worth the setup time - batchcraft - 09-02-2026
Posting this in case it saves someone else a little time.
I'm not trying to build a perfect architecture diagram. I just want a sane starting point around vLLM and M3 Max.
Would rather learn from your scars than collect my own all at once.
For context, I'm not chasing leaderboard numbers. I mostly want the system to feel consistent day to day.
Re: TensorRT-LLM worth the setup time - kernelmike - 09-02-2026
Not sure I agree there. I've seen people blame router policy when the real issue was much more mundane. Could be a workload difference, but I wouldn't generalize too fast from one setup.