+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Prompting & Context Engineering (https://www.datasculpting.ai/inference/forumdisplay.php?fid=15)
+--- Forum: Long Context / Memory (https://www.datasculpting.ai/inference/forumdisplay.php?fid=64)
+--- Thread: long context that stayed useful (/showthread.php?tid=33)
Pages:
1
2
Re: long context that stayed useful - sanepeak48 - 08-29-2026
Quote:worth checking the driver first.
I think the bottleneck is somewhere else. The reported numbers can look compelling, but in ordinary usage I didn't see the same benefit. Worth testing the simpler explanation before adopting the more interesting one. At this point the real bottleneck is my patience.
Re: long context that stayed useful - ggufvault - 08-30-2026
What worked for me was pretty simple. On 5090, the easiest win is often to back off the aggressive settings and see whether the problem survives. Once you know the plain path works, then add the faster path back in piece by piece.
Re: long context that stayed useful - turboscope5 - 09-02-2026
My first guess would be this: If you're on SGLang, I'd confirm the version first and then reduce variables until the behavior is obvious. A lot of these threads end up being one bad config plus a pile of conclusions drawn from it.
Re: long context that stayed useful - edgequill - 09-02-2026
Did a small comparison this afternoon. On dual 3090 with LM Studio, I saw basically the same behavior. The main thing that moved was latency, not quality.
Re: long context that stayed useful - torchkite - 09-03-2026
that fixed it for me too.