10-09-2026, 04:24 PM
Thought I'd post a small recipe because a lot of threads ask similar things.
Just sharing a setup that ended up working reasonably well: Kimi, llama.cpp, A6000, with a lot of attention on router policy.
Feel free to tear it apart if you see something dumb.
The part that surprised me was how much the boring details mattered more than the model choice.
Just sharing a setup that ended up working reasonably well: Kimi, llama.cpp, A6000, with a lot of attention on router policy.
Feel free to tear it apart if you see something dumb.
The part that surprised me was how much the boring details mattered more than the model choice.