+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Edge AI & Gadgets (https://www.datasculpting.ai/inference/forumdisplay.php?fid=21)
+--- Forum: Mobile (https://www.datasculpting.ai/inference/forumdisplay.php?fid=73)
+--- Thread: mobile NPU reality check (/showthread.php?tid=703)
mobile NPU reality check - fastquill74 - 10-03-2026
Posting this in case it saves someone else a little time.
If you were starting from scratch today for this use case, what would you choose first and what would you ignore?
Simple and boring is a valid answer.
This is mostly for local work rather than public serving.
If I had to summarize the lesson so far, it would be that clean setup and observability beat clever guesses.
Re: mobile NPU reality check - cobaltworks25 - 10-03-2026
Quote:Posting this in case it saves someone else a little time.
Maybe, but I had the opposite result. I've seen people blame NVFP4 when the real issue was much more mundane. Not saying you're wrong, just that I wouldn't lock that in as the lesson yet.
Re: mobile NPU reality check - cudacrate - 10-04-2026
Ran a quick check on my box. The issue went away once I changed one setting and restarted the stack cleanly. I expected the model choice to matter more than it did.
Re: mobile NPU reality check - plainscope50 - 10-04-2026
worth checking the driver first.
If you post your exact settings, people here can probably narrow it down pretty fast.
Re: mobile NPU reality check - fusedriver - 10-05-2026
Quote:worth checking the driver first.
following this because I'm in the same boat.
Re: mobile NPU reality check - cozywire - 10-05-2026
My first guess would be this: If you're on LM Studio, I'd confirm the version first and then reduce variables until the behavior is obvious.
Re: mobile NPU reality check - macroforge - 10-05-2026
Thanks, that helps. The pattern around workstation thermals has been pretty similar for me. The biggest change for me was simplifying the stack instead of adding one more optimization layer.
If you post your exact settings, people here can probably narrow it down pretty fast.
Re: mobile NPU reality check - relaysupply90 - 10-05-2026
Quote:Thanks, that helps. The pattern around workstation thermals has been pretty similar for me. The biggest change for me was simplifying the stack instea
that fixed it for me too.
Re: mobile NPU reality check - macrotinker - 10-05-2026
Quote:[quote]Thanks, that helps. The pattern around workstation thermals has been pretty similar for me. The biggest change for me was simplifying the stack
A couple things I'd check first. Before rebuilding anything, I'd test one clean baseline with Phi and compare from there. A lot of these threads end up being one bad config plus a pile of conclusions drawn from it.
Re: mobile NPU reality check - pixelcrate82 - 10-05-2026
Tried to reproduce it just now. The issue went away once I changed one setting and restarted the stack cleanly. The surprise was that memory pressure showed up before throughput collapsed.