![]() |
|
setup notes worth sharing on 4090 - Printable Version +- Inference (https://www.datasculpting.ai/inference) +-- Forum: LLM Models (https://www.datasculpting.ai/inference/forumdisplay.php?fid=12) +--- Forum: Open Weight (https://www.datasculpting.ai/inference/forumdisplay.php?fid=49) +---- Forum: Local (https://www.datasculpting.ai/inference/forumdisplay.php?fid=51) +---- Thread: setup notes worth sharing on 4090 (/showthread.php?tid=39) |
setup notes worth sharing on 4090 - phasespark - 08-26-2026 Spent some time on this today and wanted to compare notes. I'm comparing two approaches here: keep it simple on GB200, or squeeze more out of the stack and deal with the complexity. Interested in tradeoffs more than fan loyalty. My use case is pretty ordinary: local chat, some document work, and occasional batch jobs. Re: setup notes worth sharing on 4090 - vramstream - 08-27-2026 Can you fill in a bit more context? Is this local-only or are you routing anything externally? |