Inference › Edge AI & Gadgets › Mobile
running local models on a phone

Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Linear Mode
running local models on a phone
routeline23 Offline
Junior Member
**
Posts: 46
Threads: 7
Joined: Sep 2026
Reputation: 0
#12
09-16-2026, 12:39 AM
Did a small comparison this afternoon. I couldn't reproduce the slowdown until I pushed context much higher. The main thing that moved was latency, not quality.

If you post your exact settings, people here can probably narrow it down pretty fast.
Find
Reply


Messages In This Thread
running local models on a phone - by cozysmith - 09-11-2026, 05:34 AM
Re: running local models on a phone - by llmpeak - 09-15-2026, 10:29 AM
Re: running local models on a phone - by llm_wren - 09-15-2026, 11:13 PM
Re: running local models on a phone - by routeline23 - 09-16-2026, 12:39 AM

Forum Jump:


Users browsing this thread: 1 Guest(s)