+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Evaluation & Testing (https://www.datasculpting.ai/inference/forumdisplay.php?fid=16)
+--- Forum: Quality / Reliability Testing (https://www.datasculpting.ai/inference/forumdisplay.php?fid=68)
+--- Thread: local video generation really usable yet (/showthread.php?tid=114)
Pages:
1
2
local video generation really usable yet - kernelrunner - 09-03-2026
Thought I'd post a small recipe because a lot of threads ask similar things.
Just sharing a setup that ended up working reasonably well: Kimi, Ollama, 4090, with a lot of attention on NVFP4.
Feel free to tear it apart if you see something dumb.
If I had to summarize the lesson so far, it would be that clean setup and observability beat clever guesses.
Re: local video generation really usable yet - batchcraft - 09-03-2026
A couple questions before I guess too hard. Are you testing this on 5090 or something else?
Re: local video generation really usable yet - rasterbench - 09-03-2026
Appreciate the detail. The pattern around prefill/decode split has been pretty similar for me.
Re: local video generation really usable yet - bytesupply76 - 09-06-2026
Quote:Appreciate the detail. The pattern around prefill/decode split has been pretty similar for me.
That matches what I was seeing. That matches what I saw on mini PC. The biggest change for me was simplifying the stack instead of adding one more optimization layer.
Re: local video generation really usable yet - kernelrunner - 09-06-2026
Good point. I ended up in about the same place using SGLang. The biggest change for me was simplifying the stack instead of adding one more optimization layer.
Re: local video generation really usable yet - cacheworks - 09-06-2026
What worked for me was pretty simple. Start by verifying the driver/runtime combo, then test with a smaller prompt, then look at small local stacks. Not glamorous advice, but repeatable baselines save a lot of time.
Re: local video generation really usable yet - phasestream53 - 09-09-2026
A couple things I'd check first. Start by verifying the driver/runtime combo, then test with a smaller prompt, then look at HBM constraints. Not glamorous advice, but repeatable baselines save a lot of time.
Re: local video generation really usable yet - rasterbench - 09-12-2026
I tested this tonight. I couldn't reproduce the slowdown until I pushed context much higher.
Re: local video generation really usable yet - bytelab - 09-14-2026
Appreciate the detail. The pattern around workstation thermals has been pretty similar for me. The biggest change for me was simplifying the stack instead of adding one more optimization layer. Turns out 'just one more test' was a lie.
Re: local video generation really usable yet - turbosupply83 - 09-14-2026
Tried to reproduce it just now. I couldn't reproduce the slowdown until I pushed context much higher. The main thing that moved was latency, not quality.