CLI helpers for local models for Gemma

Thread Rating:

0 Vote(s) - 0 Average
1
2
3
4
5

Linear Mode

CLI helpers for local models for Gemma

mlxgarden Offline

Offline

Member

Posts: 199
Threads: 27
Joined: Sep 2026
Reputation: 0

#5

10-10-2026, 11:20 PM

I'd approach it in a boring order. Start by verifying the driver/runtime combo, then test with a smaller prompt, then look at INT4.

M3 Max • MLX • local-first

Find

Reply

« Next Oldest | Next Newest »

Messages In This Thread

CLI helpers for local models for Gemma - by modgarden - 10-08-2026, 06:32 PM

Re: CLI helpers for local models for Gemma - by mlxgarden - 10-09-2026, 06:53 PM

Re: CLI helpers for local models for Gemma - by rocmhouse90 - 10-10-2026, 07:39 PM

Re: CLI helpers for local models for Gemma - by vramarch - 10-11-2026, 07:57 AM

Re: CLI helpers for local models for Gemma - by batchpeak - 10-10-2026, 09:49 PM

Re: CLI helpers for local models for Gemma - by mlxgarden - 10-10-2026, 11:20 PM

Re: CLI helpers for local models for Gemma - by vectorport - 10-10-2026, 11:46 PM

Re: CLI helpers for local models for Gemma - by mlxgarden - 10-11-2026, 10:10 AM

Re: CLI helpers for local models for Gemma - by rocmriley - 10-11-2026, 06:34 PM

Re: CLI helpers for local models for Gemma - by audioriver - 10-11-2026, 09:05 PM

Re: CLI helpers for local models for Gemma - by vramstream - 10-13-2026, 02:16 AM

Re: CLI helpers for local models for Gemma - by kernelmike - 10-12-2026, 09:33 PM

Re: CLI helpers for local models for Gemma - by visionyard23 - 10-13-2026, 02:49 AM

View a Printable Version

Forum Jump:

Users browsing this thread: 1 Guest(s)