+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Hardware (https://www.datasculpting.ai/inference/forumdisplay.php?fid=4)
+--- Forum: Systems & Builds (https://www.datasculpting.ai/inference/forumdisplay.php?fid=29)
+--- Thread: rackmount vs tower for homelab inference: setup advice (/showthread.php?tid=957)
Pages:
1
2
Re: rackmount vs tower for homelab inference: setup advice - batchwire - 10-15-2026
Can you fill in a bit more context? Are you testing this on GB200 or something else?
Re: rackmount vs tower for homelab inference: setup advice - tensorport - 10-15-2026
same here on my side.
Re: rackmount vs tower for homelab inference: setup advice - Data Sculpting - 10-17-2026
Maybe, but I had the opposite result. I get why that seems right, but on dual 3090 the bottleneck felt elsewhere. Not saying you're wrong, just that I wouldn't lock that in as the lesson yet.
Re: rackmount vs tower for homelab inference: setup advice - cozygrid12 - 10-18-2026
Interesting, I hadn't tried that. The pattern around prefill/decode split has been pretty similar for me. I got better results once I stopped chasing one metric and just looked at whether the workflow felt usable.