Posts: 37
Threads: 6
Joined: Oct 2026
Reputation:
0
Did a bit of testing and thought I'd post the result here.
I tried this with Phi using LM Studio on M3 Max. The headline result was better than I expected, but tokens/sec still ended up being the limiting factor.
Nothing scientific here, just practical notes from a real setup.
My use case is pretty ordinary: local chat, some document work, and occasional batch jobs.
Posts: 31
Threads: 2
Joined: Oct 2026
Reputation:
0
A couple things I'd check first. If you're on LM Studio, I'd confirm the version first and then reduce variables until the behavior is obvious. A lot of these threads end up being one bad config plus a pile of conclusions drawn from it.
Posts: 73
Threads: 6
Joined: Sep 2026
Reputation:
0
What exact setup are you running? Are you testing this on mini PC or something else?
Posts: 121
Threads: 15
Joined: Sep 2026
Reputation:
0
I'd start with the simpler stack.
image models by night, local pipelines by day
Posts: 52
Threads: 4
Joined: Sep 2026
Reputation:
0
What worked for me was pretty simple. Before rebuilding anything, I'd test one clean baseline with Llama and compare from there. A lot of these threads end up being one bad config plus a pile of conclusions drawn from it.
Posts: 41
Threads: 4
Joined: Aug 2026
Reputation:
0
I don't think that's the whole story. I've seen people blame batch size when the real issue was much more mundane. Worth testing the simpler explanation before adopting the more interesting one.
