CLI helpers for local models on 5090

Thread Rating:

0 Vote(s) - 0 Average
1
2
3
4
5

Linear Mode

CLI helpers for local models on 5090

rocmriley Offline

Member

Posts: 211
Threads: 21
Joined: Sep 2026
Reputation: 0

09-06-2026, 02:28 AM

Did a bit of testing and thought I'd post the result here.

Short version: TensorRT-LLM behaved well for me, but only after I stopped ignoring router policy.

Happy to post more details if anyone wants them.

7900 XTX / ROCm / somehow still optimistic

Find

« Next Oldest | Next Newest »

Messages In This Thread

CLI helpers for local models on 5090 - by rocmriley - 09-06-2026, 02:28 AM

Re: CLI helpers for local models on 5090 - by signalcraft14 - 09-06-2026, 03:09 AM

Re: CLI helpers for local models on 5090 - by vectorport - 09-06-2026, 03:51 PM

Re: CLI helpers for local models on 5090 - by llmpeak - 09-07-2026, 05:31 PM

Re: CLI helpers for local models on 5090 - by relayforge - 09-12-2026, 09:57 AM

Re: CLI helpers for local models on 5090 - by rasterbench - 09-13-2026, 10:55 AM

Re: CLI helpers for local models on 5090 - by mintstation99 - 09-06-2026, 11:21 AM

Re: CLI helpers for local models on 5090 - by cachebench - 09-07-2026, 04:36 PM

Re: CLI helpers for local models on 5090 - by rocmhouse90 - 09-12-2026, 10:22 PM

Re: CLI helpers for local models on 5090 - by mlxgarden - 09-07-2026, 09:39 PM

Re: CLI helpers for local models on 5090 - by rocmhouse90 - 09-07-2026, 11:13 PM

Re: CLI helpers for local models on 5090 - by rocmriley - 09-10-2026, 11:24 PM

Re: CLI helpers for local models on 5090 - by relayforge - 09-11-2026, 03:27 AM

Re: CLI helpers for local models on 5090 - by cachebench - 09-12-2026, 04:02 AM

Re: CLI helpers for local models on 5090 - by macropoint - 09-12-2026, 05:29 AM

Re: CLI helpers for local models on 5090 - by fusedhall56 - 09-13-2026, 12:31 PM

View a Printable Version

Forum Jump:

Users browsing this thread: 1 Guest(s)

Login
Username:
Password:	Lost Password?
	Remember me

Sign in with X.com