09-16-2026, 11:51 PM
This keeps coming up in conversation so I figured I'd start a thread.
The more I work with local setups, the more it seems like long context decides everything downstream.
Curious whether that lines up with what other people are seeing. The logs were somehow calmer than I was.
The more I work with local setups, the more it seems like long context decides everything downstream.
Curious whether that lines up with what other people are seeing. The logs were somehow calmer than I was.
2x3090 • llama.cpp • too much VRAM is still not enough