+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Training & Customization (https://www.datasculpting.ai/inference/forumdisplay.php?fid=13)
+--- Forum: Fine-Tuning / LoRA (https://www.datasculpting.ai/inference/forumdisplay.php?fid=54)
+--- Thread: workflow automation with local models (/showthread.php?tid=496)
workflow automation with local models - ggufvault - 09-25-2026
I'm trying to sanity-check my setup.
I'm mostly working with Llama in LM Studio on A6000. The part I'm trying to understand is tail latency.
Not looking for the perfect answer, mostly what worked in real use.
Re: workflow automation with local models - labline - 09-26-2026
Tried to reproduce it just now. The issue went away once I changed one setting and restarted the stack cleanly. The surprise was that memory pressure showed up before throughput collapsed.
Re: workflow automation with local models - relaynest82 - 09-26-2026
Did a small comparison this afternoon. I couldn't reproduce the slowdown until I pushed context much higher. The surprise was that memory pressure showed up before throughput collapsed.