vision-language models on consumer gear with llama.cpp

Thread Rating:

0 Vote(s) - 0 Average
1
2
3
4
5

Linear Mode

vision-language models on consumer gear with llama.cpp

cachelab Offline

Offline

Junior Member

Posts: 25
Threads: 4
Joined: Aug 2026
Reputation: 0

#10

10-19-2026, 02:30 AM

What worked for me was pretty simple. If you're on MLX, I'd confirm the version first and then reduce variables until the behavior is obvious.

small models can still be good

Find

Reply

« Next Oldest | Next Newest »

Messages In This Thread

vision-language models on consumer gear with llama.cpp - by benchplease - 10-15-2026, 04:52 AM

Re: vision-language models on consumer gear with llama.cpp - by thetaember38 - 10-15-2026, 06:05 AM

Re: vision-language models on consumer gear with llama.cpp - by visionforge - 10-16-2026, 06:05 PM

Re: vision-language models on consumer gear with llama.cpp - by cobaltworks25 - 10-16-2026, 08:42 PM

Re: vision-language models on consumer gear with llama.cpp - by phasespark - 10-18-2026, 09:12 AM

Re: vision-language models on consumer gear with llama.cpp - by labline - 10-18-2026, 08:18 PM

Re: vision-language models on consumer gear with llama.cpp - by visionforge - 10-18-2026, 08:51 PM

Re: vision-language models on consumer gear with llama.cpp - by phaseport36 - 10-18-2026, 09:14 PM

Re: vision-language models on consumer gear with llama.cpp - by audiopath66 - 10-18-2026, 10:11 PM

Re: vision-language models on consumer gear with llama.cpp - by cachelab - 10-19-2026, 02:30 AM

Re: vision-language models on consumer gear with llama.cpp - by rocmhouse90 - 10-19-2026, 03:20 AM

Re: vision-language models on consumer gear with llama.cpp - by cachelab - 10-19-2026, 04:30 AM

Re: vision-language models on consumer gear with llama.cpp - by visionforge - 10-19-2026, 05:03 AM

View a Printable Version

Forum Jump:

Users browsing this thread: 1 Guest(s)