Apple unified memory limits: setup advice

[mellowstream]

I'd approach it in a boring order. Before rebuilding anything, I'd test one clean baseline with Mixtral and compare from there. Not glamorous advice,

Can you fill in a bit more context? Is this local-only or are you routing anything externally?