distill or just quantize for Mistral

[amberpatch25]

Tried to reproduce it just now. On A6000 with Ollama, I saw basically the same behavior. The surprise was that memory pressure showed up before throughput collapsed. The logs were somehow calmer than I was.

[phasescope]

subscribed, curious where this lands.