+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Generative AI (https://www.datasculpting.ai/inference/forumdisplay.php?fid=17)
+--- Forum: Multimodal (https://www.datasculpting.ai/inference/forumdisplay.php?fid=72)
+--- Thread: Multimodal discussion: setup advice (/showthread.php?tid=528)
Multimodal discussion: setup advice - torchsupply99 - 09-28-2026
I figured I'd ask here before changing everything.
I'm trying to decide whether to keep the current stack or change course. Main question is how people here are handling tokens/sec.
If you've tested something similar, what did you keep and what did you stop bothering with?
Re: Multimodal discussion: setup advice - macropilot - 09-30-2026
Tried to reproduce it just now. I couldn't reproduce the slowdown until I pushed context much higher.