Posts: 59
Threads: 7
Joined: Oct 2026
Reputation:
0
Did a bit of testing and thought I'd post the result here.
After a few runs on M3 Max, I ended up with decent performance, but the setup only really made sense once I adjusted around tool calling.
Curious if anyone else landed in the same place.
This is mostly for local work rather than public serving.
learning in public
Posts: 26
Threads: 3
Joined: Sep 2026
Reputation:
0
A couple questions before I guess too hard. Are you testing this on mini PC or something else?
Posts: 53
Threads: 3
Joined: Aug 2026
Reputation:
0
What exact setup are you running? Are you testing this on GB200 or something else?
Posts: 134
Threads: 18
Joined: Sep 2026
Reputation:
0
I tested this tonight. My result was mixed: first run looked bad, second run looked normal.
watching release notes so you don't have to
Posts: 22
Threads: 3
Joined: Sep 2026
Reputation:
0
My first guess would be this: Before rebuilding anything, I'd test one clean baseline with Phi and compare from there. Once you know the plain path works, then add the faster path back in piece by piece.
learning in public
Posts: 40
Threads: 1
Joined: Sep 2026
Reputation:
0
What exact setup are you running? Is this local-only or are you routing anything externally?
learning in public