![]() |
|
vision-language models on consumer gear for Kimi - Printable Version +- Inference (https://www.datasculpting.ai/inference) +-- Forum: Generative AI (https://www.datasculpting.ai/inference/forumdisplay.php?fid=17) +--- Forum: Video (https://www.datasculpting.ai/inference/forumdisplay.php?fid=70) +--- Thread: vision-language models on consumer gear for Kimi (/showthread.php?tid=454) |
vision-language models on consumer gear for Kimi - audiopath66 - 09-24-2026 Maybe I'm missing something obvious. My current setup is SGLang with 4090, and I keep running into small local stacks. Would appreciate practical advice rather than theory. This is mostly for local work rather than public serving. Re: vision-language models on consumer gear for Kimi - flintriver50 - 09-26-2026 Thanks, that helps. That matches what I saw on 5090. |