+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Hardware (https://www.datasculpting.ai/inference/forumdisplay.php?fid=4)
+--- Forum: Systems & Builds (https://www.datasculpting.ai/inference/forumdisplay.php?fid=29)
+--- Thread: quiet dual-GPU build advice (/showthread.php?tid=362)
Pages:
1
2
quiet dual-GPU build advice - stackpilot - 09-20-2026
This keeps coming up in conversation so I figured I'd start a thread.
The more I work with local setups, the more it seems like NVFP4 decides everything downstream.
Maybe obvious to some of you, but it clicked for me this week.
I care more about stability than squeezing the last possible tokens/sec out of it.
Re: quiet dual-GPU build advice - homelabhenry - 09-22-2026
Quote:This keeps coming up in conversation so I figured I'd start a thread.
worth checking the driver first.
Re: quiet dual-GPU build advice - emberpeak - 09-22-2026
Quote:Quote:This keeps coming up in conversation so I figured I'd start a thread.
Tried to reproduce it just now. My result was mixed: first run looked bad, second run looked normal.
Re: quiet dual-GPU build advice - kernelarch - 09-22-2026
I tested this tonight. I couldn't reproduce the slowdown until I pushed context much higher.
Re: quiet dual-GPU build advice - sanevault - 09-22-2026
Good point. That matches what I saw on 4090. Worth rechecking your defaults though, because one bad assumption can make the rest of the thread look confusing.
Re: quiet dual-GPU build advice - bytegarden73 - 09-22-2026
Quote:Good point. That matches what I saw on 4090. Worth rechecking your defaults though, because one bad assumption can make the rest of the thread look co
I'd approach it in a boring order. Start by verifying the driver/runtime combo, then test with a smaller prompt, then look at INT4. Not glamorous advice, but repeatable baselines save a lot of time.
Re: quiet dual-GPU build advice - routeforge64 - 09-25-2026
That matches what I was seeing. I don't think your conclusion is far off.
Re: quiet dual-GPU build advice - batchyard - 09-27-2026
worth checking the driver first.
Re: quiet dual-GPU build advice - homelabhenry - 09-30-2026
Can you fill in a bit more context? Are you testing this on B200 or something else?
Re: quiet dual-GPU build advice - cudaline - 09-30-2026
What worked for me was pretty simple. On M3 Max, the easiest win is often to back off the aggressive settings and see whether the problem survives.