+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Miscellaneous Discussion (https://www.datasculpting.ai/inference/forumdisplay.php?fid=24)
+--- Forum: News & Industry (https://www.datasculpting.ai/inference/forumdisplay.php?fid=26)
+--- Thread: driver/framework news roundup (/showthread.php?tid=1418)
driver/framework news roundup - thetashed24 - 10-18-2026
Did a bit of testing and thought I'd post the result here.
After a few runs on M3 Max, I ended up with decent performance, but the setup only really made sense once I adjusted around tool calling.
Curious if anyone else landed in the same place.
This is mostly for local work rather than public serving.
Re: driver/framework news roundup - bytehall - 10-18-2026
A couple questions before I guess too hard. Are you testing this on mini PC or something else?
Re: driver/framework news roundup - southpatch - 10-18-2026
What exact setup are you running? Are you testing this on GB200 or something else?
Re: driver/framework news roundup - deepseeked - 10-18-2026
I tested this tonight. My result was mixed: first run looked bad, second run looked normal.
Re: driver/framework news roundup - torchsupply99 - 10-18-2026
My first guess would be this: Before rebuilding anything, I'd test one clean baseline with Phi and compare from there. Once you know the plain path works, then add the faster path back in piece by piece.
Re: driver/framework news roundup - vectorpoint - 10-19-2026
What exact setup are you running? Is this local-only or are you routing anything externally?