09-20-2026, 01:21 AM
I don't think that's the whole story. I wouldn't optimize around that first. On my side the bigger swing came from the runtime and not the model. Not saying you're wrong, just that I wouldn't lock that in as the lesson yet.
2x3090 • llama.cpp • too much VRAM is still not enough
