Inference
Help with Multimodal - Printable Version

+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Generative AI (https://www.datasculpting.ai/inference/forumdisplay.php?fid=17)
+--- Forum: Multimodal (https://www.datasculpting.ai/inference/forumdisplay.php?fid=72)
+--- Thread: Help with Multimodal (/showthread.php?tid=318)



Help with Multimodal - southtinker - 09-16-2026

Spent some time on this today and wanted to compare notes.

I've gone back and forth between LM Studio and SGLang for DeepSeek. The interesting difference for me has been tokens/sec.

Interested in tradeoffs more than fan loyalty.

For context, I'm not chasing leaderboard numbers. I mostly want the system to feel consistent day to day.