Instinct pricing thoughts with TensorRT-LLM

Thread Rating:

0 Vote(s) - 0 Average
1
2
3
4
5

Linear Mode

Instinct pricing thoughts with TensorRT-LLM

batchscope72 Offline

Offline

Junior Member

Posts: 39
Threads: 8
Joined: Aug 2026
Reputation: 0

#13

10-09-2026, 04:31 AM

What exact setup are you running? Do you see the same thing with a smaller batch or shorter prompt?

mostly local

Find

Reply

« Next Oldest | Next Newest »

Messages In This Thread

Instinct pricing thoughts with TensorRT-LLM - by fastquill74 - 09-26-2026, 03:42 PM

Re: Instinct pricing thoughts with TensorRT-LLM - by signalpeak - 09-28-2026, 04:11 PM

Re: Instinct pricing thoughts with TensorRT-LLM - by northhall88 - 10-01-2026, 04:35 PM

Re: Instinct pricing thoughts with TensorRT-LLM - by tensorworks - 10-02-2026, 05:09 AM

Re: Instinct pricing thoughts with TensorRT-LLM - by macropoint - 10-02-2026, 05:54 PM

Re: Instinct pricing thoughts with TensorRT-LLM - by routeline23 - 10-05-2026, 07:49 PM

Re: Instinct pricing thoughts with TensorRT-LLM - by northhall88 - 10-05-2026, 06:16 PM

Re: Instinct pricing thoughts with TensorRT-LLM - by phasetrack - 10-05-2026, 09:27 PM

Re: Instinct pricing thoughts with TensorRT-LLM - by macropoint - 10-06-2026, 01:33 AM

Re: Instinct pricing thoughts with TensorRT-LLM - by rocmriley - 10-07-2026, 02:21 PM

Re: Instinct pricing thoughts with TensorRT-LLM - by dockworks23 - 10-08-2026, 02:42 AM

Re: Instinct pricing thoughts with TensorRT-LLM - by mangohouse - 10-08-2026, 04:07 AM

Re: Instinct pricing thoughts with TensorRT-LLM - by batchscope72 - 10-09-2026, 04:31 AM

View a Printable Version

Forum Jump:

Users browsing this thread: 1 Guest(s)