+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Generative AI (https://www.datasculpting.ai/inference/forumdisplay.php?fid=17)
+--- Forum: Multimodal (https://www.datasculpting.ai/inference/forumdisplay.php?fid=72)
+--- Thread: Multimodal discussion (/showthread.php?tid=776)
Pages:
1
2
Re: Multimodal discussion - southtinker - 10-13-2026
Interesting, I hadn't tried that. The pattern around HBM constraints has been pretty similar for me. The biggest change for me was simplifying the stack instead of adding one more optimization layer.
Re: Multimodal discussion - visionforge - 10-13-2026
Can you fill in a bit more context? What model, what runtime, and roughly what context size?
Re: Multimodal discussion - macrotinker - 10-14-2026
Quote:Can you fill in a bit more context? What model, what runtime, and roughly what context size?
A couple things I'd check first. Before rebuilding anything, I'd test one clean baseline with Llama and compare from there. A lot of these threads end up being one bad config plus a pile of conclusions drawn from it.
Re: Multimodal discussion - southtinker - 10-14-2026
same here on my side. The logs were somehow calmer than I was.