CUDA update broke my throughput with TensorRT-LLM

Thread Rating:

0 Vote(s) - 0 Average
1
2
3
4
5

Linear Mode

CUDA update broke my throughput with TensorRT-LLM

audiopath66 Offline

Junior Member

Posts: 46
Threads: 6
Joined: Sep 2026
Reputation: 0

08-29-2026, 09:57 PM

Ran a quick check on my box. The issue went away once I changed one setting and restarted the stack cleanly. The surprise was that memory pressure showed up before throughput collapsed.

Find

« Next Oldest | Next Newest »

Messages In This Thread

CUDA update broke my throughput with TensorRT-LLM - by audiopath66 - 08-26-2026, 07:31 PM

Re: CUDA update broke my throughput with TensorRT-LLM - by kernelmike - 08-26-2026, 08:45 PM

Re: CUDA update broke my throughput with TensorRT-LLM - by audioriver - 08-26-2026, 08:56 PM

Re: CUDA update broke my throughput with TensorRT-LLM - by quantshed - 08-29-2026, 10:46 PM

Re: CUDA update broke my throughput with TensorRT-LLM - by mangohouse - 08-28-2026, 09:31 AM

Re: CUDA update broke my throughput with TensorRT-LLM - by audiopath66 - 08-29-2026, 09:57 PM

Re: CUDA update broke my throughput with TensorRT-LLM - by kernelmike - 09-01-2026, 11:29 PM

Re: CUDA update broke my throughput with TensorRT-LLM - by latentgarden - 09-02-2026, 01:37 AM

Re: CUDA update broke my throughput with TensorRT-LLM - by thetapath - 09-03-2026, 02:08 PM

Re: CUDA update broke my throughput with TensorRT-LLM - by audioforge - 09-03-2026, 04:20 PM

Re: CUDA update broke my throughput with TensorRT-LLM - by latentgarden - 09-03-2026, 05:07 PM

Re: CUDA update broke my throughput with TensorRT-LLM - by phaseport36 - 09-03-2026, 09:51 PM

View a Printable Version

Forum Jump:

Users browsing this thread: 1 Guest(s)

Login
Username:
Password:	Lost Password?
	Remember me

Sign in with X.com