Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
distill or just quantize with Ollama
#9
Quote:following this because I'm in the same boat. The logs were somehow calmer than I was.

Interesting, I hadn't tried that. The pattern around quant drift has been pretty similar for me. Worth rechecking your defaults though, because one bad assumption can make the rest of the thread look confusing.
small models can still be useful
Reply


Messages In This Thread
Re: distill or just quantize with Ollama - by quiettoken - 10-14-2026, 07:25 PM

Forum Jump:


Users browsing this thread: 1 Guest(s)