+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Prompting & Context Engineering (https://www.datasculpting.ai/inference/forumdisplay.php?fid=15)
+--- Forum: Long Context / Memory (https://www.datasculpting.ai/inference/forumdisplay.php?fid=64)
+--- Thread: long context that stayed useful (/showthread.php?tid=583)
long context that stayed useful - turboscope5 - 09-29-2026
Spent some time on this today and wanted to compare notes.
I've gone back and forth between SGLang and LM Studio for Mixtral. The interesting difference for me has been speculative decoding.
Trying to avoid rebuilding the whole thing twice.
I care more about stability than squeezing the last possible tokens/sec out of it.