Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
running local models on a phone
#3
Interesting, I hadn't tried that. I ended up in about the same place using PyTorch. The biggest change for me was simplifying the stack instead of adding one more optimization layer.

If you post your exact settings, people here can probably narrow it down pretty fast.
Reply


Messages In This Thread
running local models on a phone - by batchpeak - 10-19-2026, 05:12 AM
Re: running local models on a phone - by llmpeak - 10-18-2026, 09:39 PM
Re: running local models on a phone - by torchkite - 10-18-2026, 09:54 PM

Forum Jump:


Users browsing this thread: 1 Guest(s)