Posts: 36
Threads: 8
Joined: Aug 2026
Reputation:
0
Spent some time on this today and wanted to compare notes.
I've gone back and forth between LM Studio and llama.cpp for Llama. The interesting difference for me has been reranking.
Interested in tradeoffs more than fan loyalty.
My use case is pretty ordinary: local chat, some document work, and occasional batch jobs.
Posts: 29
Threads: 5
Joined: Aug 2026
Reputation:
0
A couple things I'd check first. Before rebuilding anything, I'd test one clean baseline with Phi and compare from there.
Posts: 45
Threads: 2
Joined: Aug 2026
Reputation:
0
That matches what I was seeing. I ended up in about the same place using LM Studio.
Posts: 30
Threads: 3
Joined: Sep 2026
Reputation:
0
What worked for me was pretty simple. If you're on LM Studio, I'd confirm the version first and then reduce variables until the behavior is obvious. Once you know the plain path works, then add the faster path back in piece by piece. I keep promising myself this is the last rebuild.
Posts: 60
Threads: 5
Joined: Sep 2026
Reputation:
0
A couple things I'd check first. Before rebuilding anything, I'd test one clean baseline with Qwen and compare from there. A lot of these threads end up being one bad config plus a pile of conclusions drawn from it.
Posts: 44
Threads: 3
Joined: Oct 2026
Reputation:
0
Appreciate the detail. I ended up in about the same place using Ollama.
small models can still be good
