CLI helpers for local models with MLX

Thread Rating:

0 Vote(s) - 0 Average
1
2
3
4
5

Linear Mode

CLI helpers for local models with MLX

batchshed Offline

Offline

Member

Posts: 74
Threads: 9
Joined: Sep 2026
Reputation: 0

#11

10-13-2026, 09:13 PM

A couple things I'd check first. Start by verifying the driver/runtime combo, then test with a smaller prompt, then look at VRAM headroom.

learning in public

Find

Reply

« Next Oldest | Next Newest »

Messages In This Thread

CLI helpers for local models with MLX - by batchshed - 10-08-2026, 06:39 PM

Re: CLI helpers for local models with MLX - by cachebench - 10-10-2026, 07:12 AM

Re: CLI helpers for local models with MLX - by audionode8 - 10-10-2026, 07:28 PM

Re: CLI helpers for local models with MLX - by deltagrid - 10-13-2026, 06:58 PM

Re: CLI helpers for local models with MLX - by batchshed - 10-13-2026, 09:13 PM

Re: CLI helpers for local models with MLX - by mlxgarden - 10-12-2026, 08:12 AM

Re: CLI helpers for local models with MLX - by rocmriley - 10-12-2026, 08:35 PM

Re: CLI helpers for local models with MLX - by tinycontext - 10-13-2026, 10:03 PM

Re: CLI helpers for local models with MLX - by vectorport - 10-13-2026, 05:04 AM

Re: CLI helpers for local models with MLX - by kernelgrid - 10-13-2026, 09:22 AM

Re: CLI helpers for local models with MLX - by rocmhouse90 - 10-13-2026, 11:55 AM

Re: CLI helpers for local models with MLX - by audionode8 - 10-13-2026, 02:26 PM

Re: CLI helpers for local models with MLX - by kernelgrid - 10-14-2026, 10:51 AM

View a Printable Version

Forum Jump:

Users browsing this thread: 1 Guest(s)