Inference
desktop runtimes for non-devs - Printable Version

+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Inference Engines (https://www.datasculpting.ai/inference/forumdisplay.php?fid=9)
+--- Forum: Ollama / LM Studio / Desktop Runtimes (https://www.datasculpting.ai/inference/forumdisplay.php?fid=38)
+--- Thread: desktop runtimes for non-devs (/showthread.php?tid=1479)

Pages: 1 2


Re: desktop runtimes for non-devs - pixelspark - 10-19-2026

Tried to reproduce it just now. The issue went away once I changed one setting and restarted the stack cleanly. I expected the model choice to matter more than it did.


Re: desktop runtimes for non-devs - emberquill - 10-19-2026

A couple things I'd check first. On Threadripper box, the easiest win is often to back off the aggressive settings and see whether the problem survives.