Inference
vision-language models on consumer gear for Kimi - Printable Version

+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Generative AI (https://www.datasculpting.ai/inference/forumdisplay.php?fid=17)
+--- Forum: Video (https://www.datasculpting.ai/inference/forumdisplay.php?fid=70)
+--- Thread: vision-language models on consumer gear for Kimi (/showthread.php?tid=454)



vision-language models on consumer gear for Kimi - audiopath66 - 09-24-2026

Maybe I'm missing something obvious.

My current setup is SGLang with 4090, and I keep running into small local stacks.

Would appreciate practical advice rather than theory.

This is mostly for local work rather than public serving.


Re: vision-language models on consumer gear for Kimi - flintriver50 - 09-26-2026

Thanks, that helps. That matches what I saw on 5090.