10-04-2026, 12:58 PM
Did a bit of testing and thought I'd post the result here.
Short version: llama.cpp behaved well for me, but only after I stopped ignoring quant drift.
Nothing scientific here, just practical notes from a real setup.
My use case is pretty ordinary: local chat, some document work, and occasional batch jobs.
Short version: llama.cpp behaved well for me, but only after I stopped ignoring quant drift.
Nothing scientific here, just practical notes from a real setup.
My use case is pretty ordinary: local chat, some document work, and occasional batch jobs.
routing beats arguing over one perfect model
