10-15-2026, 08:15 PM
Ran a quick check on my box. I couldn't reproduce the slowdown until I pushed context much higher. I expected the model choice to matter more than it did.
local image tinkerer
Inference
›
Evaluation & Testing
›
Quality / Reliability Testing
video model setup pain points with TensorRT-LLM
video model setup pain points with TensorRT-LLM
|
video model setup pain points with TensorRT-LLM
|
|
« Next Oldest | Next Newest »
|
| Messages In This Thread |
|
video model setup pain points with TensorRT-LLM - by forgemixer - 10-12-2026, 11:09 AM
Re: video model setup pain points with TensorRT-LLM - by vramstream - 10-14-2026, 11:46 AM
Re: video model setup pain points with TensorRT-LLM - by batchwire - 10-14-2026, 12:22 PM
Re: video model setup pain points with TensorRT-LLM - by audioforge - 10-14-2026, 04:32 PM
Re: video model setup pain points with TensorRT-LLM - by quiethouse - 10-15-2026, 05:09 AM
Re: video model setup pain points with TensorRT-LLM - by batchsize - 10-15-2026, 07:58 AM
Re: video model setup pain points with TensorRT-LLM - by llmtrack - 10-15-2026, 08:15 PM
Re: video model setup pain points with TensorRT-LLM - by benchplease - 10-15-2026, 08:47 PM
|
Users browsing this thread: 1 Guest(s)