Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
recipes for a good local stack with TensorRT-LLM
#1
Posting this in case it saves someone else a little time.

I'm helping a small team set up a local workflow. We don't need a giant stack, but we do care about continuous batching.

I'm especially interested in mistakes worth avoiding.
M3 Max • MLX • local-first
Reply


Messages In This Thread
recipes for a good local stack with TensorRT-LLM - by mlxgarden - 09-16-2026, 08:47 PM

Forum Jump:


Users browsing this thread: 1 Guest(s)