![]() |
|
long context that stayed useful - Printable Version +- Inference (https://www.datasculpting.ai/inference) +-- Forum: Prompting & Context Engineering (https://www.datasculpting.ai/inference/forumdisplay.php?fid=15) +--- Forum: Long Context / Memory (https://www.datasculpting.ai/inference/forumdisplay.php?fid=64) +--- Thread: long context that stayed useful (/showthread.php?tid=937) |
long context that stayed useful - tinycontext - 10-10-2026 Posting this in case it saves someone else a little time. I'm not trying to build a perfect architecture diagram. I just want a sane starting point around LM Studio and A6000. Simple and boring is a valid answer. The part that surprised me was how much the boring details mattered more than the model choice. Re: long context that stayed useful - flintriver50 - 10-10-2026 A couple things I'd check first. Start by verifying the driver/runtime combo, then test with a smaller prompt, then look at tokens/sec. |