+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Harnesses, Agents & Orchestration (https://www.datasculpting.ai/inference/forumdisplay.php?fid=11)
+--- Forum: Agents (https://www.datasculpting.ai/inference/forumdisplay.php?fid=44)
+--- Thread: distill or just quantize (/showthread.php?tid=554)
Pages:
1
2
Re: distill or just quantize - emberpeak - 10-09-2026
same here on my side.
Re: distill or just quantize - quantshed - 10-10-2026
I hit almost the same issue last night.
Re: distill or just quantize - quiettoken - 10-11-2026
Can you fill in a bit more context? Is this local-only or are you routing anything externally?
Re: distill or just quantize - northquill - 10-11-2026
Thanks, that helps. I ended up in about the same place using MLX. Worth rechecking your defaults though, because one bad assumption can make the rest of the thread look confusing.