+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Hardware (https://www.datasculpting.ai/inference/forumdisplay.php?fid=4)
+--- Forum: Systems & Builds (https://www.datasculpting.ai/inference/forumdisplay.php?fid=29)
+--- Thread: quiet dual-GPU build advice (/showthread.php?tid=228)
quiet dual-GPU build advice - localcraft17 - 09-12-2026
Did a bit of testing and thought I'd post the result here.
I tried this with Mistral using TensorRT-LLM on mini PC. The headline result was better than I expected, but speculative decoding still ended up being the limiting factor.
Happy to post more details if anyone wants them.
Re: quiet dual-GPU build advice - edgequill - 09-12-2026
Quote:Did a bit of testing and thought I'd post the result here.
What worked for me was pretty simple. Start by verifying the driver/runtime combo, then test with a smaller prompt, then look at continuous batching. Not glamorous advice, but repeatable baselines save a lot of time.
Re: quiet dual-GPU build advice - bytepilot - 09-12-2026
That matches what I was seeing. I don't think your conclusion is far off. Worth rechecking your defaults though, because one bad assumption can make the rest of the thread look confusing.