09-28-2026, 06:47 PM
Posting this in case it saves someone else a little time.
I'm not trying to build a perfect architecture diagram. I just want a sane starting point around SGLang and A6000.
Would rather learn from your scars than collect my own all at once.
My use case is pretty ordinary: local chat, some document work, and occasional batch jobs.
I'm not trying to build a perfect architecture diagram. I just want a sane starting point around SGLang and A6000.
Would rather learn from your scars than collect my own all at once.
My use case is pretty ordinary: local chat, some document work, and occasional batch jobs.
