+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Edge AI & Gadgets (https://www.datasculpting.ai/inference/forumdisplay.php?fid=21)
+--- Forum: Mobile (https://www.datasculpting.ai/inference/forumdisplay.php?fid=73)
+--- Thread: mobile NPU reality check with PyTorch (/showthread.php?tid=96)
mobile NPU reality check with PyTorch - quietsupply11 - 09-01-2026
This keeps coming up in conversation so I figured I'd start a thread.
The more I work with local setups, the more it seems like INT4 decides everything downstream.
Maybe obvious to some of you, but it clicked for me this week.
This is mostly for local work rather than public serving.