why did throughput drop after update: early impressions

[signalpeak]

Need a little more detail here. What model, what runtime, and roughly what context size?

I tested this tonight. My result was mixed: first run looked bad, second run looked normal. The surprise was that memory pressure showed up before throughput collapsed.

If you post your exact settings, people here can probably narrow it down pretty fast.