disaggregated inference thoughts on M3 Max

Thread Rating:

0 Vote(s) - 0 Average
1
2
3
4
5

Linear Mode

disaggregated inference thoughts on M3 Max

quantsupply Offline

Offline

Junior Member

Posts: 34
Threads: 4
Joined: Aug 2026
Reputation: 0

#12

08-30-2026, 10:46 AM

Interesting, I hadn't tried that. I don't think your conclusion is far off.

small models can still be good

Find

Reply

« Next Oldest | Next Newest »

Messages In This Thread

disaggregated inference thoughts on M3 Max - by cozyarch - 08-22-2026, 04:51 PM

Re: disaggregated inference thoughts on M3 Max - by edgeriver - 08-22-2026, 05:41 PM

Re: disaggregated inference thoughts on M3 Max - by tensorfield88 - 08-23-2026, 05:47 PM

Re: disaggregated inference thoughts on M3 Max - by kernelmike - 08-24-2026, 02:37 AM

Re: disaggregated inference thoughts on M3 Max - by kernelmike - 09-02-2026, 02:09 PM

Re: disaggregated inference thoughts on M3 Max - by labline - 08-23-2026, 09:57 PM

Re: disaggregated inference thoughts on M3 Max - by cudapeak - 08-24-2026, 03:19 AM

Re: disaggregated inference thoughts on M3 Max - by cozygrid12 - 08-24-2026, 03:38 AM

Re: disaggregated inference thoughts on M3 Max - by kernelmike - 08-30-2026, 10:00 AM

Re: disaggregated inference thoughts on M3 Max - by kernelmike - 08-27-2026, 04:16 AM

Re: disaggregated inference thoughts on M3 Max - by rocmhouse90 - 08-27-2026, 05:12 AM

Re: disaggregated inference thoughts on M3 Max - by cudapeak - 08-30-2026, 05:39 AM

Re: disaggregated inference thoughts on M3 Max - by quantsupply - 08-30-2026, 10:46 AM

Re: disaggregated inference thoughts on M3 Max - by macropilot - 09-02-2026, 11:26 AM

Re: disaggregated inference thoughts on M3 Max - by tensorfield88 - 09-02-2026, 02:56 PM

View a Printable Version

Forum Jump:

Users browsing this thread: 1 Guest(s)