batching changes after update for Llama

[amberpatch25]

A couple things I'd check first. Before rebuilding anything, I'd test one clean baseline with Mixtral and compare from there. Not glamorous advice, but repeatable baselines save a lot of time.