Inference
context stuffing mistakes: what are you seeing? - Printable Version

+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Prompting & Context Engineering (https://www.datasculpting.ai/inference/forumdisplay.php?fid=15)
+--- Forum: Long Context / Memory (https://www.datasculpting.ai/inference/forumdisplay.php?fid=64)
+--- Thread: context stuffing mistakes: what are you seeing? (/showthread.php?tid=108)

Pages: 1 2


Re: context stuffing mistakes: what are you seeing? - latentpeak22 - 09-09-2026

I think the bottleneck is somewhere else. I've seen people blame prefill/decode split when the real issue was much more mundane.


Re: context stuffing mistakes: what are you seeing? - circuitkite - 09-09-2026

My first guess would be this: On 5090, the easiest win is often to back off the aggressive settings and see whether the problem survives.