+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Miscellaneous Discussion (https://www.datasculpting.ai/inference/forumdisplay.php?fid=24)
+--- Forum: General (https://www.datasculpting.ai/inference/forumdisplay.php?fid=25)
+--- Thread: new here, what's your stack with LM Studio (/showthread.php?tid=1062)
Pages:
1
2
new here, what's your stack with LM Studio - batchscope72 - 10-12-2026
Posting this in case it saves someone else a little time.
I'm helping a small team set up a local workflow. We don't need a giant stack, but we do care about MoE serving.
Would rather learn from your scars than collect my own all at once.
Re: new here, what's your stack with LM Studio - orbitline - 10-12-2026
My first guess would be this: On 7900 XTX, the easiest win is often to back off the aggressive settings and see whether the problem survives. Not glamorous advice, but repeatable baselines save a lot of time.
Re: new here, what's your stack with LM Studio - vramscope - 10-12-2026
Need a little more detail here. What model, what runtime, and roughly what context size?
Re: new here, what's your stack with LM Studio - ggufwire22 - 10-12-2026
subscribed, curious where this lands.
Re: new here, what's your stack with LM Studio - tensorkite - 10-12-2026
My first guess would be this: Before rebuilding anything, I'd test one clean baseline with DeepSeek and compare from there.
Re: new here, what's your stack with LM Studio - quiettoken - 10-15-2026
I think the bottleneck is somewhere else. The reported numbers can look compelling, but in ordinary usage I didn't see the same benefit. Could be a workload difference, but I wouldn't generalize too fast from one setup.
Re: new here, what's your stack with LM Studio - ggufwire22 - 10-15-2026
I'd approach it in a boring order. Before rebuilding anything, I'd test one clean baseline with Phi and compare from there. Once you know the plain path works, then add the faster path back in piece by piece.
Re: new here, what's your stack with LM Studio - rocmplane - 10-15-2026
Did a small comparison this afternoon. My result was mixed: first run looked bad, second run looked normal. The surprise was that memory pressure showed up before throughput collapsed.
Re: new here, what's your stack with LM Studio - quiettoken - 10-17-2026
Thanks, that helps. The pattern around MoE serving has been pretty similar for me. Worth rechecking your defaults though, because one bad assumption can make the rest of the thread look confusing.
Re: new here, what's your stack with LM Studio - mangotinker73 - 10-17-2026
A couple things I'd check first. On B200, the easiest win is often to back off the aggressive settings and see whether the problem survives. A lot of these threads end up being one bad config plus a pile of conclusions drawn from it. I keep promising myself this is the last rebuild.