10-11-2026, 09:23 PM
Good point. The pattern around INT4 has been pretty similar for me. Worth rechecking your defaults though, because one bad assumption can make the rest of the thread look confusing.
small models can still be useful