Inference
memory layers vs plain long context - Printable Version

+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Prompting & Context Engineering (https://www.datasculpting.ai/inference/forumdisplay.php?fid=15)
+--- Forum: Long Context / Memory (https://www.datasculpting.ai/inference/forumdisplay.php?fid=64)
+--- Thread: memory layers vs plain long context (/showthread.php?tid=401)



memory layers vs plain long context - mellowsupply - 09-21-2026

Spent some time on this today and wanted to compare notes.

I'm comparing two approaches here: keep it simple on Threadripper box, or squeeze more out of the stack and deal with the complexity.

What would you pick if you had to live with it for a few months?


Re: memory layers vs plain long context - fastfield4 - 09-22-2026

Quote:Spent some time on this today and wanted to compare notes.

Tried to reproduce it just now. My result was mixed: first run looked bad, second run looked normal. I expected the model choice to matter more than it did.

I'm happy to test one more variant if you want a second data point.