+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Prompting & Context Engineering (https://www.datasculpting.ai/inference/forumdisplay.php?fid=15)
+--- Forum: Prompts / System Prompts (https://www.datasculpting.ai/inference/forumdisplay.php?fid=62)
+--- Thread: prompt length getting silly for Phi (/showthread.php?tid=99)
prompt length getting silly for Phi - northgarden37 - 09-02-2026
Did a bit of testing and thought I'd post the result here.
After a few runs on dual 3090, I ended up with decent performance, but the setup only really made sense once I adjusted around NVFP4.
Curious if anyone else landed in the same place.
My use case is pretty ordinary: local chat, some document work, and occasional batch jobs.
Re: prompt length getting silly for Phi - thetaarch43 - 09-02-2026
I'd approach it in a boring order. On M3 Max, the easiest win is often to back off the aggressive settings and see whether the problem survives.
Re: prompt length getting silly for Phi - audionode8 - 09-02-2026
Quote:I'd approach it in a boring order. On M3 Max, the easiest win is often to back off the aggressive settings and see whether the problem survives.
That matches what I was seeing. The pattern around tool calling has been pretty similar for me.