10-19-2026, 05:33 AM
Quote:[quote]I think the bottleneck is somewhere else. I wouldn't optimize around that first. On my side the bigger swing came from the runtime and not the
A couple things I'd check first. Before rebuilding anything, I'd test one clean baseline with Mistral and compare from there.
small models can still be good