setup notes worth sharing on 4090

[phasespark]

Spent some time on this today and wanted to compare notes.

I'm comparing two approaches here: keep it simple on GB200, or squeeze more out of the stack and deal with the complexity.

Interested in tradeoffs more than fan loyalty.

My use case is pretty ordinary: local chat, some document work, and occasional batch jobs.

[vramstream]

Can you fill in a bit more context? Is this local-only or are you routing anything externally?