70B still worth the pain with llama.cpp

Thread Rating:

0 Vote(s) - 0 Average
1
2
3
4
5

Linear Mode

70B still worth the pain with llama.cpp

cacheline Offline

Offline

Senior Member

Posts: 341
Threads: 51
Joined: Sep 2026
Reputation: 0

#16

10-16-2026, 06:43 PM

Can you fill in a bit more context? Is this local-only or are you routing anything externally?

measure twice, benchmark three times

Find

Reply

« Next Oldest | Next Newest »

Messages In This Thread

70B still worth the pain with llama.cpp - by quantsupply - 10-05-2026, 12:30 AM

Re: 70B still worth the pain with llama.cpp - by vramarch - 10-05-2026, 05:20 AM

Re: 70B still worth the pain with llama.cpp - by latentscope35 - 10-05-2026, 06:55 AM

Re: 70B still worth the pain with llama.cpp - by llm_wren - 10-12-2026, 12:54 AM

Re: 70B still worth the pain with llama.cpp - by orbitgarden - 10-05-2026, 06:18 AM

Re: 70B still worth the pain with llama.cpp - by oxideworks59 - 10-05-2026, 07:12 PM

Re: 70B still worth the pain with llama.cpp - by modgarden - 10-05-2026, 07:52 PM

Re: 70B still worth the pain with llama.cpp - by oxidegrove40 - 10-05-2026, 09:13 PM

Re: 70B still worth the pain with llama.cpp - by pixelspark - 10-08-2026, 09:36 PM

Re: 70B still worth the pain with llama.cpp - by stackpilot - 10-09-2026, 09:41 PM

Re: 70B still worth the pain with llama.cpp - by edgekite - 10-10-2026, 10:22 AM

Re: 70B still worth the pain with llama.cpp - by amberpatch25 - 10-11-2026, 10:54 PM

Re: 70B still worth the pain with llama.cpp - by cacheline - 10-16-2026, 06:43 PM

Re: 70B still worth the pain with llama.cpp - by mellowsupply - 10-12-2026, 05:25 AM

Re: 70B still worth the pain with llama.cpp - by mintstation99 - 10-13-2026, 05:49 PM

Re: 70B still worth the pain with llama.cpp - by orbitbench6 - 10-13-2026, 06:14 PM

View a Printable Version

Forum Jump:

Users browsing this thread: 1 Guest(s)