+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Prompting & Context Engineering (https://www.datasculpting.ai/inference/forumdisplay.php?fid=15)
+--- Forum: Long Context / Memory (https://www.datasculpting.ai/inference/forumdisplay.php?fid=64)
+--- Thread: context stuffing mistakes on 7900 XTX (/showthread.php?tid=1420)
context stuffing mistakes on 7900 XTX - deltastation - 10-17-2026
Posting this in case it saves someone else a little time.
I'm helping a small team set up a local workflow. We don't need a giant stack, but we do care about NVFP4.
Simple and boring is a valid answer.
Re: context stuffing mistakes on 7900 XTX - mangotinker73 - 10-17-2026
same here on my side.
Re: context stuffing mistakes on 7900 XTX - fusedhall56 - 10-18-2026
I tested this tonight. On 5090 with TensorRT-LLM, I saw basically the same behavior. I expected the model choice to matter more than it did.
Re: context stuffing mistakes on 7900 XTX - quantghost - 10-18-2026
Quote:I tested this tonight. On 5090 with TensorRT-LLM, I saw basically the same behavior. I expected the model choice to matter more than it did.
What worked for me was pretty simple. Start by verifying the driver/runtime combo, then test with a smaller prompt, then look at small local stacks. Once you know the plain path works, then add the faster path back in piece by piece.
Re: context stuffing mistakes on 7900 XTX - bytesupply76 - 10-18-2026
Quote:[quote]I tested this tonight. On 5090 with TensorRT-LLM, I saw basically the same behavior. I expected the model choice to matter more than it did.[/q
Thanks, that helps. I ended up in about the same place using Ollama. The biggest change for me was simplifying the stack instead of adding one more optimization layer.
Re: context stuffing mistakes on 7900 XTX - fusedhall56 - 10-18-2026
I'd approach it in a boring order. On Threadripper box, the easiest win is often to back off the aggressive settings and see whether the problem survives. Not glamorous advice, but repeatable baselines save a lot of time.
Re: context stuffing mistakes on 7900 XTX - plainember52 - 10-19-2026
Quote:[quote][quote]I tested this tonight. On 5090 with TensorRT-LLM, I saw basically the same behavior. I expected the model choice to matter more than it
worth checking the driver first.
Re: context stuffing mistakes on 7900 XTX - turboscope5 - 10-19-2026
Quote:that fixed it for me too.
Thanks, that helps. I don't think your conclusion is far off. Worth rechecking your defaults though, because one bad assumption can make the rest of the thread look confusing.
Re: context stuffing mistakes on 7900 XTX - vrampilot - 10-19-2026
that fixed it for me too.
Re: context stuffing mistakes on 7900 XTX - tinycontext - 10-19-2026
My first guess would be this: On A6000, the easiest win is often to back off the aggressive settings and see whether the problem survives. A lot of these threads end up being one bad config plus a pile of conclusions drawn from it.