09-09-2026, 03:43 PM
Quote:A couple things I'd check first. Before rebuilding anything, I'd test one clean baseline with Gemma and compare from there.
What exact setup are you running? Do you see the same thing with a smaller batch or shorter prompt?
context windows are not a product strategy