+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Evaluation & Testing (https://www.datasculpting.ai/inference/forumdisplay.php?fid=16)
+--- Forum: Quality / Reliability Testing (https://www.datasculpting.ai/inference/forumdisplay.php?fid=68)
+--- Thread: when video is still not worth the wait: anyone testing this? (/showthread.php?tid=519)
Pages:
1
2
Re: when video is still not worth the wait: anyone testing this? - marbletrack - 10-03-2026
My first guess would be this: Before rebuilding anything, I'd test one clean baseline with Llama and compare from there. A lot of these threads end up being one bad config plus a pile of conclusions drawn from it.
Re: when video is still not worth the wait: anyone testing this? - plaingarden18 - 10-03-2026
I think the bottleneck is somewhere else. The reported numbers can look compelling, but in ordinary usage I didn't see the same benefit.
Re: when video is still not worth the wait: anyone testing this? - oxideworks59 - 10-03-2026
Tried to reproduce it just now. I couldn't reproduce the slowdown until I pushed context much higher. The main thing that moved was latency, not quality.
Re: when video is still not worth the wait: anyone testing this? - cacheline - 10-04-2026
What exact setup are you running? Do you see the same thing with a smaller batch or shorter prompt?