when TensorRT-LLM clearly wins: early impressions

Thread Rating:

0 Vote(s) - 0 Average
1
2
3
4
5

Linear Mode

when TensorRT-LLM clearly wins: early impressions

relayforge Offline

Offline

Member

Posts: 58
Threads: 8
Joined: Sep 2026
Reputation: 0

#6

10-01-2026, 12:18 AM

A couple questions before I guess too hard. Do you see the same thing with a smaller batch or shorter prompt?

trying not to rebuild again

Find

Reply

« Next Oldest | Next Newest »

Messages In This Thread

when TensorRT-LLM clearly wins: early impressions - by vectorport - 09-29-2026, 05:31 PM

Re: when TensorRT-LLM clearly wins: early impressions - by rocmstack25 - 09-30-2026, 05:42 AM

Re: when TensorRT-LLM clearly wins: early impressions - by sysstation69 - 09-30-2026, 06:21 PM

Re: when TensorRT-LLM clearly wins: early impressions - by turbosupply83 - 09-30-2026, 10:30 PM

Re: when TensorRT-LLM clearly wins: early impressions - by pixelcrate82 - 09-30-2026, 11:08 PM

Re: when TensorRT-LLM clearly wins: early impressions - by kernelmike - 10-01-2026, 02:13 PM

Re: when TensorRT-LLM clearly wins: early impressions - by relayforge - 10-01-2026, 12:18 AM

Re: when TensorRT-LLM clearly wins: early impressions - by vectorport - 10-01-2026, 02:18 AM

Re: when TensorRT-LLM clearly wins: early impressions - by kernelmike - 10-01-2026, 03:13 AM

Re: when TensorRT-LLM clearly wins: early impressions - by sysstation69 - 10-01-2026, 11:39 AM

Re: when TensorRT-LLM clearly wins: early impressions - by vectorport - 10-02-2026, 02:43 AM

Re: when TensorRT-LLM clearly wins: early impressions - by kernelmike - 10-02-2026, 02:59 AM

Re: when TensorRT-LLM clearly wins: early impressions - by vramport - 10-03-2026, 03:12 PM

View a Printable Version

Forum Jump:

Users browsing this thread: 1 Guest(s)