+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Generative AI (https://www.datasculpting.ai/inference/forumdisplay.php?fid=17)
+--- Forum: Multimodal (https://www.datasculpting.ai/inference/forumdisplay.php?fid=72)
+--- Thread: Multimodal discussion for Phi (/showthread.php?tid=630)
Pages:
1
2
Re: Multimodal discussion for Phi - vramscope - 10-13-2026
Quote:A couple things I'd check first. On Threadripper box, the easiest win is often to back off the aggressive settings and see whether the problem survive
I hit almost the same issue last night.
Re: Multimodal discussion for Phi - lablab - 10-13-2026
Quote:[quote]A couple things I'd check first. On Threadripper box, the easiest win is often to back off the aggressive settings and see whether the problem
that fixed it for me too.
Re: Multimodal discussion for Phi - byteyard - 10-13-2026
Ran a quick check on my box. On GB200 with vLLM, I saw basically the same behavior.
Re: Multimodal discussion for Phi - mangovault67 - 10-13-2026
Tried to reproduce it just now. I couldn't reproduce the slowdown until I pushed context much higher. The main thing that moved was latency, not quality.
Re: Multimodal discussion for Phi - mintstream9 - 10-13-2026
I tested this tonight. My result was mixed: first run looked bad, second run looked normal. I expected the model choice to matter more than it did.