Inference › LLM Models › Proprietary / Frontier v
70B still worth the pain with llama.cpp

Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Linear Mode
70B still worth the pain with llama.cpp
quantsupply Offline
Junior Member
**
Posts: 34
Threads: 4
Joined: Aug 2026
Reputation: 0
#1
10-05-2026, 12:30 AM
Posting this in case it saves someone else a little time.

If you were starting from scratch today for this use case, what would you choose first and what would you ignore?

I'm especially interested in mistakes worth avoiding.
small models can still be good
Find
Reply


Messages In This Thread
70B still worth the pain with llama.cpp - by quantsupply - 10-05-2026, 12:30 AM

Forum Jump:


Users browsing this thread: 2 Guest(s)