+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Edge AI & Gadgets (https://www.datasculpting.ai/inference/forumdisplay.php?fid=21)
+--- Forum: Mobile (https://www.datasculpting.ai/inference/forumdisplay.php?fid=73)
+--- Thread: running local models on a phone with PyTorch (/showthread.php?tid=1350)
Pages:
1
2
Re: running local models on a phone with PyTorch - benchplease - 10-19-2026
A couple things I'd check first. Before rebuilding anything, I'd test one clean baseline with Qwen and compare from there.
Re: running local models on a phone with PyTorch - torchkite - 10-19-2026
Can you fill in a bit more context? Do you see the same thing with a smaller batch or shorter prompt?
Re: running local models on a phone with PyTorch - marbleyard32 - 10-19-2026
Good point. I don't think your conclusion is far off. Worth rechecking your defaults though, because one bad assumption can make the rest of the thread look confusing.