+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Training & Customization (https://www.datasculpting.ai/inference/forumdisplay.php?fid=13)
+--- Forum: Fine-Tuning / LoRA (https://www.datasculpting.ai/inference/forumdisplay.php?fid=54)
+--- Thread: small agent harness that stayed useful with LM Studio (/showthread.php?tid=507)
Pages:
1
2
small agent harness that stayed useful with LM Studio - amberplane - 09-26-2026
Wanted to compare notes with people doing similar things.
I'm mostly working with Qwen in llama.cpp on 5090. The part I'm trying to understand is NVFP4.
Would appreciate practical advice rather than theory.
Re: small agent harness that stayed useful with LM Studio - southden - 09-26-2026
Quote:Wanted to compare notes with people doing similar things.
Can you fill in a bit more context? Is this local-only or are you routing anything externally?
Re: small agent harness that stayed useful with LM Studio - cudacrate - 09-26-2026
Interesting, I hadn't tried that. That matches what I saw on 4090. I got better results once I stopped chasing one metric and just looked at whether the workflow felt usable.
Re: small agent harness that stayed useful with LM Studio - southden - 09-27-2026
What exact setup are you running? Do you see the same thing with a smaller batch or shorter prompt?
Re: small agent harness that stayed useful with LM Studio - northgrid33 - 09-27-2026
Need a little more detail here. Do you see the same thing with a smaller batch or shorter prompt?
Re: small agent harness that stayed useful with LM Studio - llm_wren - 09-30-2026
Good point. That matches what I saw on A6000. Worth rechecking your defaults though, because one bad assumption can make the rest of the thread look confusing.
Re: small agent harness that stayed useful with LM Studio - northgrid33 - 09-30-2026
that fixed it for me too.
Re: small agent harness that stayed useful with LM Studio - bytegarden73 - 09-30-2026
Thanks, that helps. The pattern around small local stacks has been pretty similar for me. I got better results once I stopped chasing one metric and just looked at whether the workflow felt usable.
Re: small agent harness that stayed useful with LM Studio - southden - 10-01-2026
Good point. The pattern around reranking has been pretty similar for me. The biggest change for me was simplifying the stack instead of adding one more optimization layer.
Re: small agent harness that stayed useful with LM Studio - ggufvault - 10-04-2026
Can you fill in a bit more context? Do you see the same thing with a smaller batch or shorter prompt?