Inference › Harnesses, Agents & Orchestration › Agents
distillation that keeps useful behavior with llama.cpp

Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Linear Mode
distillation that keeps useful behavior with llama.cpp
quiettoken Offline
Member
***
Posts: 142
Threads: 20
Joined: Sep 2026
Reputation: 0
#10
10-10-2026, 10:46 PM
Interesting, I hadn't tried that. I don't think your conclusion is far off. The biggest change for me was simplifying the stack instead of adding one more optimization layer.
small models can still be useful
Find
Reply


Messages In This Thread
Re: distillation that keeps useful behavior with llama.cpp - by quiettoken - 10-10-2026, 10:46 PM

Forum Jump:


Users browsing this thread: 1 Guest(s)