+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Evaluation & Testing (https://www.datasculpting.ai/inference/forumdisplay.php?fid=16)
+--- Forum: Model Comparisons (https://www.datasculpting.ai/inference/forumdisplay.php?fid=67)
+--- Thread: flux pipeline local tips with SGLang (/showthread.php?tid=1234)
flux pipeline local tips with SGLang - kernelmike - 10-14-2026
Spent some time on this today and wanted to compare notes.
I've gone back and forth between SGLang and Ollama for Gemma. The interesting difference for me has been workstation thermals.
Trying to avoid rebuilding the whole thing twice.
Re: flux pipeline local tips with SGLang - tensorworks - 10-15-2026
Quote:Spent some time on this today and wanted to compare notes.
I hit almost the same issue last night.
Re: flux pipeline local tips with SGLang - minthall - 10-15-2026
A couple things I'd check first. On A6000, the easiest win is often to back off the aggressive settings and see whether the problem survives.