+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Evaluation & Testing (https://www.datasculpting.ai/inference/forumdisplay.php?fid=16)
+--- Forum: Quality / Reliability Testing (https://www.datasculpting.ai/inference/forumdisplay.php?fid=68)
+--- Thread: local video generation really usable yet for Gemma (/showthread.php?tid=748)
local video generation really usable yet for Gemma - oxidemixer - 10-05-2026
This keeps coming up in conversation so I figured I'd start a thread.
The more I work with local setups, the more it seems like batch size decides everything downstream.
Wondering if this is just where the whole space is heading now.
For context, I'm not chasing leaderboard numbers. I mostly want the system to feel consistent day to day.
Re: local video generation really usable yet for Gemma - cudahouse - 10-05-2026
Maybe, but I had the opposite result. I've seen people blame prefix caching when the real issue was much more mundane. Worth testing the simpler explanation before adopting the more interesting one.
Re: local video generation really usable yet for Gemma - quiettoken - 10-05-2026
My first guess would be this: Start by verifying the driver/runtime combo, then test with a smaller prompt, then look at INT4. Once you know the plain path works, then add the faster path back in piece by piece.
Re: local video generation really usable yet for Gemma - rocmrunner40 - 10-05-2026
Tried to reproduce it just now. The issue went away once I changed one setting and restarted the stack cleanly. The main thing that moved was latency, not quality.
If you post your exact settings, people here can probably narrow it down pretty fast.
Re: local video generation really usable yet for Gemma - mangotinker73 - 10-05-2026
My first guess would be this: On 5090, the easiest win is often to back off the aggressive settings and see whether the problem survives. Once you know the plain path works, then add the faster path back in piece by piece.
Re: local video generation really usable yet for Gemma - forgemixer - 10-05-2026
Can you fill in a bit more context? Are you testing this on M3 Max or something else?
Re: local video generation really usable yet for Gemma - plaingarden18 - 10-07-2026
same here on my side.