4090 vs 5090 for 70B quants with TensorRT-LLM

Thread Rating:

0 Vote(s) - 0 Average
1
2
3
4
5

Linear Mode

4090 vs 5090 for 70B quants with TensorRT-LLM

routecrate Offline

Offline

Member

Posts: 50
Threads: 4
Joined: Sep 2026
Reputation: 0

#8

10-18-2026, 08:08 PM

I tested this tonight. I couldn't reproduce the slowdown until I pushed context much higher.

Find

Reply

« Next Oldest | Next Newest »

Messages In This Thread

4090 vs 5090 for 70B quants with TensorRT-LLM - by turbogrid11 - 10-17-2026, 10:35 PM

Re: 4090 vs 5090 for 70B quants with TensorRT-LLM - by vrambandit - 10-17-2026, 10:51 PM

Re: 4090 vs 5090 for 70B quants with TensorRT-LLM - by rocmriley - 10-18-2026, 03:12 AM

Re: 4090 vs 5090 for 70B quants with TensorRT-LLM - by cudapoint - 10-18-2026, 03:54 AM

Re: 4090 vs 5090 for 70B quants with TensorRT-LLM - by llmtrack - 10-18-2026, 08:32 PM

Re: 4090 vs 5090 for 70B quants with TensorRT-LLM - by vrambandit - 10-18-2026, 07:03 PM

Re: 4090 vs 5090 for 70B quants with TensorRT-LLM - by embersmith - 10-18-2026, 07:45 PM

Re: 4090 vs 5090 for 70B quants with TensorRT-LLM - by batchwire - 10-18-2026, 07:56 PM

Re: 4090 vs 5090 for 70B quants with TensorRT-LLM - by routecrate - 10-18-2026, 08:08 PM

Re: 4090 vs 5090 for 70B quants with TensorRT-LLM - by amberhall - 10-19-2026, 02:37 AM

Re: 4090 vs 5090 for 70B quants with TensorRT-LLM - by torchshed - 10-19-2026, 03:27 AM

Re: 4090 vs 5090 for 70B quants with TensorRT-LLM - by fusedhall56 - 10-19-2026, 04:00 AM

Re: 4090 vs 5090 for 70B quants with TensorRT-LLM - by batchwire - 10-19-2026, 05:27 AM

View a Printable Version

Forum Jump:

Users browsing this thread: 1 Guest(s)