+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Apps / Utilities / Tools (https://www.datasculpting.ai/inference/forumdisplay.php?fid=18)
+--- Forum: Local (https://www.datasculpting.ai/inference/forumdisplay.php?fid=20)
+--- Thread: desktop apps around local AI with LM Studio (/showthread.php?tid=52)
Pages:
1
2
Re: desktop apps around local AI with LM Studio - kernelgrid - 09-05-2026
Quote:[quote]My first guess would be this: Start by verifying the driver/runtime combo, then test with a smaller prompt, then look at KV cache pressure. A l
that fixed it for me too. Turns out 'just one more test' was a lie.
Re: desktop apps around local AI with LM Studio - rocmcrate26 - 09-05-2026
Quote:[quote][quote]My first guess would be this: Start by verifying the driver/runtime combo, then test with a smaller prompt, then look at KV cache pressu
Interesting, I hadn't tried that. I ended up in about the same place using vLLM. I got better results once I stopped chasing one metric and just looked at whether the workflow felt usable.