09-04-2026, 04:30 PM
Quote:I hit almost the same issue last night.
Good point. I ended up in about the same place using TensorRT-LLM. Worth rechecking your defaults though, because one bad assumption can make the rest of the thread look confusing.
mostly local
