distillation that keeps useful behavior with llama.cpp

Thread Rating:

0 Vote(s) - 0 Average
1
2
3
4
5

Linear Mode

distillation that keeps useful behavior with llama.cpp

fusedriver Offline

Offline

Junior Member

Posts: 31
Threads: 5
Joined: Sep 2026
Reputation: 0

#2

10-07-2026, 12:49 AM

What exact setup are you running? Are you testing this on A6000 or something else?

small models can still be good

Find

Reply

« Next Oldest | Next Newest »

Messages In This Thread

distillation that keeps useful behavior with llama.cpp - by emberpeak - 10-06-2026, 12:11 AM

Re: distillation that keeps useful behavior with llama.cpp - by fusedriver - 10-07-2026, 12:49 AM

Re: distillation that keeps useful behavior with llama.cpp - by dockworks23 - 10-07-2026, 07:54 AM

Re: distillation that keeps useful behavior with llama.cpp - by quietstack - 10-07-2026, 01:43 AM

Re: distillation that keeps useful behavior with llama.cpp - by quiettoken - 10-07-2026, 03:31 AM

Re: distillation that keeps useful behavior with llama.cpp - by latentscope35 - 10-10-2026, 08:43 AM

Re: distillation that keeps useful behavior with llama.cpp - by bytegarden73 - 10-10-2026, 09:59 AM

Re: distillation that keeps useful behavior with llama.cpp - by vramridge - 10-10-2026, 11:18 AM

Re: distillation that keeps useful behavior with llama.cpp - by visionyard23 - 10-10-2026, 02:08 PM

Re: distillation that keeps useful behavior with llama.cpp - by quiettoken - 10-10-2026, 10:46 PM

Re: distillation that keeps useful behavior with llama.cpp - by latentscope35 - 10-10-2026, 11:54 PM

Re: distillation that keeps useful behavior with llama.cpp - by rocmmixer - 10-11-2026, 12:07 AM

View a Printable Version

Forum Jump:

Users browsing this thread: 1 Guest(s)