Inference
high-context local setup - Printable Version

+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: LLM Models (https://www.datasculpting.ai/inference/forumdisplay.php?fid=12)
+--- Forum: Open Weight (https://www.datasculpting.ai/inference/forumdisplay.php?fid=49)
+---- Forum: Hosted (https://www.datasculpting.ai/inference/forumdisplay.php?fid=50)
+---- Thread: high-context local setup (/showthread.php?tid=335)



high-context local setup - thetashed24 - 09-18-2026

Posting this in case it saves someone else a little time.

I'm not trying to build a perfect architecture diagram. I just want a sane starting point around MLX and M3 Max.

Simple and boring is a valid answer.


Re: high-context local setup - deepseeked - 09-19-2026

My first guess would be this: Before rebuilding anything, I'd test one clean baseline with FLUX and compare from there.


Re: high-context local setup - dockworks23 - 09-19-2026

that fixed it for me too.