Inference
local video generation really usable yet - Printable Version

+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Evaluation & Testing (https://www.datasculpting.ai/inference/forumdisplay.php?fid=16)
+--- Forum: Quality / Reliability Testing (https://www.datasculpting.ai/inference/forumdisplay.php?fid=68)
+--- Thread: local video generation really usable yet (/showthread.php?tid=84)



local video generation really usable yet - edgeriver - 08-31-2026

I figured I'd ask here before changing everything.

I'm mostly working with Kimi in Ollama on GB200. The part I'm trying to understand is consumer GPUs.

If you've tested something similar, what did you keep and what did you stop bothering with?

For context, I'm not chasing leaderboard numbers. I mostly want the system to feel consistent day to day.


Re: local video generation really usable yet - macronest - 08-31-2026

Tried to reproduce it just now. On GB200 with PyTorch, I saw basically the same behavior. The surprise was that memory pressure showed up before throughput collapsed.


Re: local video generation really usable yet - edgekite - 08-31-2026

following this because I'm in the same boat.


Re: local video generation really usable yet - bytehall - 09-01-2026

following this because I'm in the same boat.


Re: local video generation really usable yet - torchdesk - 09-01-2026

That matches what I was seeing. I don't think your conclusion is far off. I got better results once I stopped chasing one metric and just looked at whether the workflow felt usable.


Re: local video generation really usable yet - edgecoast - 09-01-2026

What exact setup are you running? Are you testing this on mini PC or something else?


Re: local video generation really usable yet - homelabhenry - 09-01-2026

Quote:What exact setup are you running? Are you testing this on mini PC or something else?

worth checking the driver first.


Re: local video generation really usable yet - rocmplane - 09-02-2026

A couple things I'd check first. If you're on PyTorch, I'd confirm the version first and then reduce variables until the behavior is obvious. Once you know the plain path works, then add the faster path back in piece by piece.


Re: local video generation really usable yet - benchplease - 09-04-2026

Ran a quick check on my box. The issue went away once I changed one setting and restarted the stack cleanly.