+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Generative AI (https://www.datasculpting.ai/inference/forumdisplay.php?fid=17)
+--- Forum: Video (https://www.datasculpting.ai/inference/forumdisplay.php?fid=70)
+--- Thread: multimodal local stack that feels real: what are you seeing? (/showthread.php?tid=364)
Pages:
1
2
Re: multimodal local stack that feels real: what are you seeing? - quietarch - 09-30-2026
Quote:Ran a quick check on my box. I couldn't reproduce the slowdown until I pushed context much higher. I expected the model choice to matter more than it
Not sure I agree there. I get why that seems right, but on Threadripper box the bottleneck felt elsewhere.