Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
driver/framework news roundup
#1
Did a bit of testing and thought I'd post the result here.

After a few runs on M3 Max, I ended up with decent performance, but the setup only really made sense once I adjusted around tool calling.

Curious if anyone else landed in the same place.

This is mostly for local work rather than public serving.
learning in public
Reply
#2
A couple questions before I guess too hard. Are you testing this on mini PC or something else?
Reply
#3
What exact setup are you running? Are you testing this on GB200 or something else?
Reply
#4
I tested this tonight. My result was mixed: first run looked bad, second run looked normal.
watching release notes so you don't have to
Reply
#5
My first guess would be this: Before rebuilding anything, I'd test one clean baseline with Phi and compare from there. Once you know the plain path works, then add the faster path back in piece by piece.
learning in public
Reply
#6
What exact setup are you running? Is this local-only or are you routing anything externally?
learning in public
Reply


Forum Jump:


Users browsing this thread: 2 Guest(s)