distillation that keeps useful behavior with llama.cpp

[quietstack]

Interesting, I hadn't tried that. The pattern around long context has been pretty similar for me. I got better results once I stopped chasing one metric and just looked at whether the workflow felt usable. At this point the real bottleneck is my patience.