Inference
what are you all running this week - Printable Version

+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Miscellaneous Discussion (https://www.datasculpting.ai/inference/forumdisplay.php?fid=24)
+--- Forum: General (https://www.datasculpting.ai/inference/forumdisplay.php?fid=25)
+--- Thread: what are you all running this week (/showthread.php?tid=1390)



what are you all running this week - plaingarden18 - 10-17-2026

Thought I'd post a small recipe because a lot of threads ask similar things.

Maybe useful as a starting point: llama.cpp on M3 Max, keeping long context in mind from the start.

Feel free to tear it apart if you see something dumb.