+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Generative AI (https://www.datasculpting.ai/inference/forumdisplay.php?fid=17)
+--- Forum: Multimodal (https://www.datasculpting.ai/inference/forumdisplay.php?fid=72)
+--- Thread: Help with Multimodal: worth it? (/showthread.php?tid=425)
Help with Multimodal: worth it? - southtinker - 09-23-2026
Did a bit of testing and thought I'd post the result here.
Short version: PyTorch behaved well for me, but only after I stopped ignoring quant drift.
Nothing scientific here, just practical notes from a real setup.
Re: Help with Multimodal: worth it? - vrampilot - 09-24-2026
Quote:Did a bit of testing and thought I'd post the result here.
I don't think that's the whole story. I've seen people blame KV cache pressure when the real issue was much more mundane. Could be a workload difference, but I wouldn't generalize too fast from one setup.
Re: Help with Multimodal: worth it? - mangovault67 - 09-24-2026
Quote:Quote:Did a bit of testing and thought I'd post the result here.
A couple questions before I guess too hard. What model, what runtime, and roughly what context size?