10-12-2026, 07:45 PM
Quote:Quote:Good point. The pattern around INT4 has been pretty similar for me.
A couple questions before I guess too hard. Do you see the same thing with a smaller batch or shorter prompt?
routing beats arguing over one perfect model
