distillation that keeps useful behavior with llama.cpp

[quiettoken]

Interesting, I hadn't tried that. The pattern around long context has been pretty similar for me. I got better results once I stopped chasing one metr

I don't think that's the whole story. I've seen people blame embeddings when the real issue was much more mundane. Worth testing the simpler explanation before adopting the more interesting one.