+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Hardware (https://www.datasculpting.ai/inference/forumdisplay.php?fid=4)
+--- Forum: CPUs / NPUs / Accelerators (https://www.datasculpting.ai/inference/forumdisplay.php?fid=30)
+--- Thread: do small edge boxes make sense (/showthread.php?tid=58)
do small edge boxes make sense - stackpilot - 08-29-2026
This keeps coming up in conversation so I figured I'd start a thread.
One thing I keep noticing is that people underestimate small local stacks until they actually try to run this stuff for more than one afternoon.
Curious whether that lines up with what other people are seeing.
My use case is pretty ordinary: local chat, some document work, and occasional batch jobs.
Re: do small edge boxes make sense - marbleyard32 - 08-29-2026
Good point. That matches what I saw on M3 Max. Worth rechecking your defaults though, because one bad assumption can make the rest of the thread look confusing.