vLLM vs SGLang for small teams for FLUX

[emberpeak]

Thought I'd post a small recipe because a lot of threads ask similar things.

Maybe useful as a starting point: llama.cpp on B200, keeping consumer GPUs in mind from the start.

Feel free to tear it apart if you see something dumb.

[fastscope]

Thought I'd post a small recipe because a lot of threads ask similar things.

I'd approach it in a boring order. On 5090, the easiest win is often to back off the aggressive settings and see whether the problem survives. A lot of these threads end up being one bad config plus a pile of conclusions drawn from it.

If you post your exact settings, people here can probably narrow it down pretty fast.