10-07-2026, 10:27 PM
I figured I'd ask here before changing everything.
My current setup is llama.cpp with A6000, and I keep running into tool calling.
If you've tested something similar, what did you keep and what did you stop bothering with?
My use case is pretty ordinary: local chat, some document work, and occasional batch jobs.
My current setup is llama.cpp with A6000, and I keep running into tool calling.
If you've tested something similar, what did you keep and what did you stop bothering with?
My use case is pretty ordinary: local chat, some document work, and occasional batch jobs.