+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Generative AI (https://www.datasculpting.ai/inference/forumdisplay.php?fid=17)
+--- Forum: Multimodal (https://www.datasculpting.ai/inference/forumdisplay.php?fid=72)
+--- Thread: Multimodal discussion (/showthread.php?tid=776)
Pages:
1
2
Multimodal discussion - southtinker - 10-06-2026
Spent some time on this today and wanted to compare notes.
I'm comparing two approaches here: keep it simple on dual 3090, or squeeze more out of the stack and deal with the complexity.
Trying to avoid rebuilding the whole thing twice.
My use case is pretty ordinary: local chat, some document work, and occasional batch jobs.
Re: Multimodal discussion - mintstream9 - 10-06-2026
Quote:Spent some time on this today and wanted to compare notes.
same here on my side.
Re: Multimodal discussion - routearch - 10-06-2026
Quote:Quote:Spent some time on this today and wanted to compare notes.
Tried to reproduce it just now. The issue went away once I changed one setting and restarted the stack cleanly. The main thing that moved was latency, not quality.
Re: Multimodal discussion - northgrid33 - 10-09-2026
following this because I'm in the same boat.
Re: Multimodal discussion - vramscope - 10-09-2026
A couple things I'd check first. Before rebuilding anything, I'd test one clean baseline with FLUX and compare from there.
Re: Multimodal discussion - cozyarch - 10-12-2026
Interesting, I hadn't tried that. I don't think your conclusion is far off. I got better results once I stopped chasing one metric and just looked at whether the workflow felt usable.
Re: Multimodal discussion - visionforge - 10-12-2026
same here on my side.
Re: Multimodal discussion - orbitgarden - 10-12-2026
Ran a quick check on my box. On GB200 with llama.cpp, I saw basically the same behavior.
Re: Multimodal discussion - lablab - 10-12-2026
Quote:Ran a quick check on my box. On GB200 with llama.cpp, I saw basically the same behavior.
Thanks, that helps. I ended up in about the same place using Ollama. Worth rechecking your defaults though, because one bad assumption can make the rest of the thread look confusing. Turns out 'just one more test' was a lie.
Re: Multimodal discussion - dockbrook21 - 10-13-2026
Good point. The pattern around KV cache pressure has been pretty similar for me. Worth rechecking your defaults though, because one bad assumption can make the rest of the thread look confusing.