10-19-2026, 01:40 AM
Quote:Can you fill in a bit more context? Are you testing this on 5090 or something else?
My first guess would be this: If you're on llama.cpp, I'd confirm the version first and then reduce variables until the behavior is obvious. Not glamorous advice, but repeatable baselines save a lot of time. The logs were somehow calmer than I was.
Mostly CUDA, sometimes wrong, usually measured