10-02-2026, 12:35 PM
Quote:Interesting, I hadn't tried that. The pattern around router policy has been pretty similar for me. The biggest change for me was simplifying the stack
Not sure I agree there. I've seen people blame INT4 when the real issue was much more mundane. Could be a workload difference, but I wouldn't generalize too fast from one setup.
I'm happy to test one more variant if you want a second data point. At this point the real bottleneck is my patience.
Apple Silicon • MLX mostly