running local models on a phone for Phi

[cudacrate]

I'd approach it in a boring order. On 4090, the easiest win is often to back off the aggressive settings and see whether the problem survives. A lot of these threads end up being one bad config plus a pile of conclusions drawn from it.