70B still worth the pain with llama.cpp

Thread Rating:

0 Vote(s) - 0 Average
1
2
3
4
5

Linear Mode

70B still worth the pain with llama.cpp

amberpatch25 Offline

Member

Posts: 83
Threads: 6
Joined: Sep 2026
Reputation: 0

#11

10-11-2026, 10:54 PM

Good point. That matches what I saw on mini PC. I got better results once I stopped chasing one metric and just looked at whether the workflow felt usable.

Find

« Next Oldest | Next Newest »

Messages In This Thread

70B still worth the pain with llama.cpp - by quantsupply - 10-05-2026, 12:30 AM

Re: 70B still worth the pain with llama.cpp - by vramarch - 10-05-2026, 05:20 AM

Re: 70B still worth the pain with llama.cpp - by latentscope35 - 10-05-2026, 06:55 AM

Re: 70B still worth the pain with llama.cpp - by llm_wren - 10-12-2026, 12:54 AM

Re: 70B still worth the pain with llama.cpp - by orbitgarden - 10-05-2026, 06:18 AM

Re: 70B still worth the pain with llama.cpp - by oxideworks59 - 10-05-2026, 07:12 PM

Re: 70B still worth the pain with llama.cpp - by modgarden - 10-05-2026, 07:52 PM

Re: 70B still worth the pain with llama.cpp - by oxidegrove40 - 10-05-2026, 09:13 PM

Re: 70B still worth the pain with llama.cpp - by pixelspark - 10-08-2026, 09:36 PM

Re: 70B still worth the pain with llama.cpp - by stackpilot - 10-09-2026, 09:41 PM

Re: 70B still worth the pain with llama.cpp - by edgekite - 10-10-2026, 10:22 AM

Re: 70B still worth the pain with llama.cpp - by amberpatch25 - 10-11-2026, 10:54 PM

Re: 70B still worth the pain with llama.cpp - by cacheline - 10-16-2026, 06:43 PM

Re: 70B still worth the pain with llama.cpp - by mellowsupply - 10-12-2026, 05:25 AM

Re: 70B still worth the pain with llama.cpp - by mintstation99 - 10-13-2026, 05:49 PM

Re: 70B still worth the pain with llama.cpp - by orbitbench6 - 10-13-2026, 06:14 PM

View a Printable Version

Forum Jump:

Users browsing this thread: 1 Guest(s)

Login
Username:
Password:	Lost Password?
	Remember me

Sign in with X.com