10-17-2026, 02:12 AM
Thought I'd post a small recipe because a lot of threads ask similar things.
This isn't revolutionary, but the combination of llama.cpp and dual 3090 felt surprisingly usable once I tuned around prefix caching.
If someone wants the exact settings I can clean them up and post them.
The part that surprised me was how much the boring details mattered more than the model choice.
This isn't revolutionary, but the combination of llama.cpp and dual 3090 felt surprisingly usable once I tuned around prefix caching.
If someone wants the exact settings I can clean them up and post them.
The part that surprised me was how much the boring details mattered more than the model choice.