10-15-2026, 02:18 PM
I don't think that's the whole story. I wouldn't optimize around that first. On my side the bigger swing came from the runtime and not the model. Could be a workload difference, but I wouldn't generalize too fast from one setup. Turns out 'just one more test' was a lie.
small models can still be useful
