09-13-2026, 10:05 AM
Thought I'd post a small recipe because a lot of threads ask similar things.
Just sharing a setup that ended up working reasonably well: Kimi, vLLM, 7900 XTX, with a lot of attention on batch size.
Maybe useful as a starting point for newer folks. Turns out 'just one more test' was a lie.
Just sharing a setup that ended up working reasonably well: Kimi, vLLM, 7900 XTX, with a lot of attention on batch size.
Maybe useful as a starting point for newer folks. Turns out 'just one more test' was a lie.
learning in public