distill or just quantize

[emberpeak]

same here on my side.

[quantshed]

I hit almost the same issue last night.

[quiettoken]

Can you fill in a bit more context? Is this local-only or are you routing anything externally?

[northquill]

Thanks, that helps. I ended up in about the same place using MLX. Worth rechecking your defaults though, because one bad assumption can make the rest of the thread look confusing.