4090 vs 5090 for 70B quants with TensorRT-LLM

Thread Rating:

0 Vote(s) - 0 Average
1
2
3
4
5

Linear Mode

4090 vs 5090 for 70B quants with TensorRT-LLM

batchwire Offline

Offline

Member

Posts: 68
Threads: 9
Joined: Sep 2026
Reputation: 0

#13

10-19-2026, 05:27 AM

Ran a quick check on my box. The issue went away once I changed one setting and restarted the stack cleanly.

Find

Reply

« Next Oldest | Next Newest »

Messages In This Thread

4090 vs 5090 for 70B quants with TensorRT-LLM - by turbogrid11 - 10-17-2026, 10:35 PM

Re: 4090 vs 5090 for 70B quants with TensorRT-LLM - by vrambandit - 10-17-2026, 10:51 PM

Re: 4090 vs 5090 for 70B quants with TensorRT-LLM - by rocmriley - 10-18-2026, 03:12 AM

Re: 4090 vs 5090 for 70B quants with TensorRT-LLM - by cudapoint - 10-18-2026, 03:54 AM

Re: 4090 vs 5090 for 70B quants with TensorRT-LLM - by llmtrack - 10-18-2026, 08:32 PM

Re: 4090 vs 5090 for 70B quants with TensorRT-LLM - by vrambandit - 10-18-2026, 07:03 PM

Re: 4090 vs 5090 for 70B quants with TensorRT-LLM - by embersmith - 10-18-2026, 07:45 PM

Re: 4090 vs 5090 for 70B quants with TensorRT-LLM - by batchwire - 10-18-2026, 07:56 PM

Re: 4090 vs 5090 for 70B quants with TensorRT-LLM - by routecrate - 10-18-2026, 08:08 PM

Re: 4090 vs 5090 for 70B quants with TensorRT-LLM - by amberhall - 10-19-2026, 02:37 AM

Re: 4090 vs 5090 for 70B quants with TensorRT-LLM - by torchshed - 10-19-2026, 03:27 AM

Re: 4090 vs 5090 for 70B quants with TensorRT-LLM - by fusedhall56 - 10-19-2026, 04:00 AM

Re: 4090 vs 5090 for 70B quants with TensorRT-LLM - by batchwire - 10-19-2026, 05:27 AM

View a Printable Version

Forum Jump:

Users browsing this thread: 1 Guest(s)