vision-language models on consumer gear with llama.cpp

Thread Rating:

0 Vote(s) - 0 Average
1
2
3
4
5

Linear Mode

vision-language models on consumer gear with llama.cpp

benchplease Offline

Offline

Member

Posts: 123
Threads: 18
Joined: Sep 2026
Reputation: 0

#1

10-15-2026, 04:52 AM

Thought I'd post a small recipe because a lot of threads ask similar things.

This isn't revolutionary, but the combination of PyTorch and B200 felt surprisingly usable once I tuned around long context.

If someone wants the exact settings I can clean them up and post them.

post logs or it didn't happen

Find

Reply

« Next Oldest | Next Newest »

Messages In This Thread

vision-language models on consumer gear with llama.cpp - by benchplease - 10-15-2026, 04:52 AM

Re: vision-language models on consumer gear with llama.cpp - by thetaember38 - 10-15-2026, 06:05 AM

Re: vision-language models on consumer gear with llama.cpp - by visionforge - 10-16-2026, 06:05 PM

Re: vision-language models on consumer gear with llama.cpp - by cobaltworks25 - 10-16-2026, 08:42 PM

Re: vision-language models on consumer gear with llama.cpp - by phasespark - 10-18-2026, 09:12 AM

Re: vision-language models on consumer gear with llama.cpp - by labline - 10-18-2026, 08:18 PM

Re: vision-language models on consumer gear with llama.cpp - by visionforge - 10-18-2026, 08:51 PM

Re: vision-language models on consumer gear with llama.cpp - by phaseport36 - 10-18-2026, 09:14 PM

Re: vision-language models on consumer gear with llama.cpp - by audiopath66 - 10-18-2026, 10:11 PM

Re: vision-language models on consumer gear with llama.cpp - by cachelab - 10-19-2026, 02:30 AM

Re: vision-language models on consumer gear with llama.cpp - by rocmhouse90 - 10-19-2026, 03:20 AM

Re: vision-language models on consumer gear with llama.cpp - by cachelab - 10-19-2026, 04:30 AM

Re: vision-language models on consumer gear with llama.cpp - by visionforge - 10-19-2026, 05:03 AM

View a Printable Version

Forum Jump:

Users browsing this thread: 1 Guest(s)