Inference
memory layers vs plain long context - Printable Version

+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Prompting & Context Engineering (https://www.datasculpting.ai/inference/forumdisplay.php?fid=15)
+--- Forum: Long Context / Memory (https://www.datasculpting.ai/inference/forumdisplay.php?fid=64)
+--- Thread: memory layers vs plain long context (/showthread.php?tid=1380)



memory layers vs plain long context - circuitkite - 10-17-2026

Spent some time on this today and wanted to compare notes.

I've gone back and forth between llama.cpp and llama.cpp for DeepSeek. The interesting difference for me has been quant drift.

What would you pick if you had to live with it for a few months?


Re: memory layers vs plain long context - edgequill - 10-17-2026

that fixed it for me too.


Re: memory layers vs plain long context - quantghost - 10-17-2026

What worked for me was pretty simple. If you're on Ollama, I'd confirm the version first and then reduce variables until the behavior is obvious. A lot of these threads end up being one bad config plus a pile of conclusions drawn from it. At this point the real bottleneck is my patience.


Re: memory layers vs plain long context - tinycontext - 10-17-2026

worth checking the driver first.


Re: memory layers vs plain long context - bytesupply76 - 10-17-2026

Ran a quick check on my box. The issue went away once I changed one setting and restarted the stack cleanly. The main thing that moved was latency, not quality.


Re: memory layers vs plain long context - flintriver50 - 10-17-2026

Interesting, I hadn't tried that. I ended up in about the same place using LM Studio.