Inference
student models for local use on M3 Max - Printable Version

+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Harnesses, Agents & Orchestration (https://www.datasculpting.ai/inference/forumdisplay.php?fid=11)
+--- Forum: Agents (https://www.datasculpting.ai/inference/forumdisplay.php?fid=44)
+--- Thread: student models for local use on M3 Max (/showthread.php?tid=605)

Pages: 1 2


Re: student models for local use on M3 Max - quietstack - 10-09-2026

same here on my side.


Re: student models for local use on M3 Max - fusedriver - 10-10-2026

Tried to reproduce it just now. On mini PC with llama.cpp, I saw basically the same behavior.


Re: student models for local use on M3 Max - rocmpath - 10-10-2026

Quote:Tried to reproduce it just now. On mini PC with llama.cpp, I saw basically the same behavior.

that fixed it for me too.