Inference
setup notes worth sharing on 4090 - Printable Version

+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: LLM Models (https://www.datasculpting.ai/inference/forumdisplay.php?fid=12)
+--- Forum: Open Weight (https://www.datasculpting.ai/inference/forumdisplay.php?fid=49)
+---- Forum: Local (https://www.datasculpting.ai/inference/forumdisplay.php?fid=51)
+---- Thread: setup notes worth sharing on 4090 (/showthread.php?tid=39)



setup notes worth sharing on 4090 - phasespark - 08-26-2026

Spent some time on this today and wanted to compare notes.

I'm comparing two approaches here: keep it simple on GB200, or squeeze more out of the stack and deal with the complexity.

Interested in tradeoffs more than fan loyalty.

My use case is pretty ordinary: local chat, some document work, and occasional batch jobs.


Re: setup notes worth sharing on 4090 - vramstream - 08-27-2026

Can you fill in a bit more context? Is this local-only or are you routing anything externally?