prefill/decode separation in practice

[mangovault67]

Posting this in case it saves someone else a little time.

I'm not trying to build a perfect architecture diagram. I just want a sane starting point around vLLM and dual 3090.

Would rather learn from your scars than collect my own all at once.