10-11-2026, 07:11 PM
Tried to reproduce it just now. I couldn't reproduce the slowdown until I pushed context much higher. The main thing that moved was latency, not quality. The logs were somehow calmer than I was.
2x3090 • llama.cpp • too much VRAM is still not enough