10-16-2026, 04:00 AM
Thought I'd post a small recipe because a lot of threads ask similar things.
This isn't revolutionary, but the combination of llama.cpp and mini PC felt surprisingly usable once I tuned around consumer GPUs.
If someone wants the exact settings I can clean them up and post them.
This is mostly for local work rather than public serving.
This isn't revolutionary, but the combination of llama.cpp and mini PC felt surprisingly usable once I tuned around consumer GPUs.
If someone wants the exact settings I can clean them up and post them.
This is mostly for local work rather than public serving.
curious and caffeinated