+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Inference Engines (https://www.datasculpting.ai/inference/forumdisplay.php?fid=9)
+--- Forum: Ollama / LM Studio / Desktop Runtimes (https://www.datasculpting.ai/inference/forumdisplay.php?fid=38)
+--- Thread: LM Studio surprisingly handy on 5090 (/showthread.php?tid=277)
Pages:
1
2
LM Studio surprisingly handy on 5090 - edgeriver - 09-14-2026
This keeps coming up in conversation so I figured I'd start a thread.
It feels like the conversation has shifted hard toward inference and serving details lately, and honestly that makes sense once you start dealing with continuous batching.
Curious whether that lines up with what other people are seeing.
My use case is pretty ordinary: local chat, some document work, and occasional batch jobs.
Re: LM Studio surprisingly handy on 5090 - amberhall - 09-15-2026
I tested this tonight. My result was mixed: first run looked bad, second run looked normal. The surprise was that memory pressure showed up before throughput collapsed.
Re: LM Studio surprisingly handy on 5090 - pixelspark - 09-15-2026
Quote:I tested this tonight. My result was mixed: first run looked bad, second run looked normal. The surprise was that memory pressure showed up before thr
Thanks, that helps. The pattern around tool calling has been pretty similar for me. The biggest change for me was simplifying the stack instead of adding one more optimization layer.
Re: LM Studio surprisingly handy on 5090 - ggufwire22 - 09-15-2026
I'd start with the simpler stack.
Re: LM Studio surprisingly handy on 5090 - vectorcrate98 - 09-15-2026
Can you fill in a bit more context? Is this local-only or are you routing anything externally?
Re: LM Studio surprisingly handy on 5090 - dockridge - 09-15-2026
I'd start with the simpler stack.
Re: LM Studio surprisingly handy on 5090 - prompttinker44 - 09-16-2026
Quote:I'd start with the simpler stack.
Appreciate the detail. I don't think your conclusion is far off. I got better results once I stopped chasing one metric and just looked at whether the workflow felt usable.
Re: LM Studio surprisingly handy on 5090 - mellowwire98 - 09-19-2026
I'd approach it in a boring order. Start by verifying the driver/runtime combo, then test with a smaller prompt, then look at structured output.
Re: LM Studio surprisingly handy on 5090 - dockridge - 09-19-2026
Appreciate the detail. The pattern around continuous batching has been pretty similar for me.
Re: LM Studio surprisingly handy on 5090 - cacheworks - 09-19-2026
Thanks, that helps. The pattern around continuous batching has been pretty similar for me. Worth rechecking your defaults though, because one bad assumption can make the rest of the thread look confusing.