CLI helpers for local models on 5090

Thread Rating:

0 Vote(s) - 0 Average
1
2
3
4
5

Linear Mode

CLI helpers for local models on 5090

cachebench Offline

Member

Posts: 63
Threads: 13
Joined: Sep 2026
Reputation: 0

#11

09-12-2026, 04:02 AM

Appreciate the detail. I ended up in about the same place using vLLM. I got better results once I stopped chasing one metric and just looked at whether the workflow felt usable.

Find

« Next Oldest | Next Newest »

Messages In This Thread

CLI helpers for local models on 5090 - by rocmriley - 09-06-2026, 02:28 AM

Re: CLI helpers for local models on 5090 - by signalcraft14 - 09-06-2026, 03:09 AM

Re: CLI helpers for local models on 5090 - by vectorport - 09-06-2026, 03:51 PM

Re: CLI helpers for local models on 5090 - by llmpeak - 09-07-2026, 05:31 PM

Re: CLI helpers for local models on 5090 - by relayforge - 09-12-2026, 09:57 AM

Re: CLI helpers for local models on 5090 - by rasterbench - 09-13-2026, 10:55 AM

Re: CLI helpers for local models on 5090 - by mintstation99 - 09-06-2026, 11:21 AM

Re: CLI helpers for local models on 5090 - by cachebench - 09-07-2026, 04:36 PM

Re: CLI helpers for local models on 5090 - by rocmhouse90 - 09-12-2026, 10:22 PM

Re: CLI helpers for local models on 5090 - by mlxgarden - 09-07-2026, 09:39 PM

Re: CLI helpers for local models on 5090 - by rocmhouse90 - 09-07-2026, 11:13 PM

Re: CLI helpers for local models on 5090 - by rocmriley - 09-10-2026, 11:24 PM

Re: CLI helpers for local models on 5090 - by relayforge - 09-11-2026, 03:27 AM

Re: CLI helpers for local models on 5090 - by cachebench - 09-12-2026, 04:02 AM

Re: CLI helpers for local models on 5090 - by macropoint - 09-12-2026, 05:29 AM

Re: CLI helpers for local models on 5090 - by fusedhall56 - 09-13-2026, 12:31 PM

View a Printable Version

Forum Jump:

Users browsing this thread: 1 Guest(s)

Login
Username:
Password:	Lost Password?
	Remember me

Sign in with X.com