Inference
local video generation really usable yet for Mistral - Printable Version

+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Evaluation & Testing (https://www.datasculpting.ai/inference/forumdisplay.php?fid=16)
+--- Forum: Quality / Reliability Testing (https://www.datasculpting.ai/inference/forumdisplay.php?fid=68)
+--- Thread: local video generation really usable yet for Mistral (/showthread.php?tid=355)

Pages: 1 2


local video generation really usable yet for Mistral - torchdesk - 09-18-2026

This keeps coming up in conversation so I figured I'd start a thread.

It feels like the conversation has shifted hard toward inference and serving details lately, and honestly that makes sense once you start dealing with reranking.

Wondering if this is just where the whole space is heading now.

I care more about stability than squeezing the last possible tokens/sec out of it.


Re: local video generation really usable yet for Mistral - bytepilot - 09-19-2026

following this because I'm in the same boat.


Re: local video generation really usable yet for Mistral - rasterbench - 09-19-2026

That matches what I was seeing. The pattern around workstation thermals has been pretty similar for me.


Re: local video generation really usable yet for Mistral - vectorpoint - 09-19-2026

Good point. That matches what I saw on mini PC.


Re: local video generation really usable yet for Mistral - tensorkite - 09-19-2026

What exact setup are you running? Are you testing this on Threadripper box or something else?


Re: local video generation really usable yet for Mistral - dockkite69 - 09-19-2026

following this because I'm in the same boat.


Re: local video generation really usable yet for Mistral - labline - 09-19-2026

Quote:following this because I'm in the same boat.

I hit almost the same issue last night.


Re: local video generation really usable yet for Mistral - nanopatch - 09-20-2026

My first guess would be this: On mini PC, the easiest win is often to back off the aggressive settings and see whether the problem survives.


Re: local video generation really usable yet for Mistral - modrunner27 - 09-20-2026

Did a small comparison this afternoon. My result was mixed: first run looked bad, second run looked normal. I expected the model choice to matter more than it did.

I'm happy to test one more variant if you want a second data point.


Re: local video generation really usable yet for Mistral - edgequill - 09-21-2026

Good point. The pattern around prefill/decode split has been pretty similar for me. The biggest change for me was simplifying the stack instead of adding one more optimization layer.