+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: LLM Models (https://www.datasculpting.ai/inference/forumdisplay.php?fid=12)
+--- Forum: Open Weight (https://www.datasculpting.ai/inference/forumdisplay.php?fid=49)
+---- Forum: Local (https://www.datasculpting.ai/inference/forumdisplay.php?fid=51)
+---- Thread: working config for 32k context with LM Studio (/showthread.php?tid=1335)
working config for 32k context with LM Studio - cachebench - 10-16-2026
Spent some time on this today and wanted to compare notes.
I'm comparing two approaches here: keep it simple on 7900 XTX, or squeeze more out of the stack and deal with the complexity.
What would you pick if you had to live with it for a few months?
For context, I'm not chasing leaderboard numbers. I mostly want the system to feel consistent day to day.