Inference › Hardware › Systems & Builds v
power delivery for 24/7 serving

Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Linear Mode
power delivery for 24/7 serving
batchsize Offline
Member
***
Posts: 137
Threads: 16
Joined: Sep 2026
Reputation: 0
#8
09-04-2026, 09:52 AM
Not sure I agree there. I get why that seems right, but on dual 3090 the bottleneck felt elsewhere. Could be a workload difference, but I wouldn't generalize too fast from one setup.
throughput matters, but tail latency matters too
Find
Reply


Messages In This Thread
power delivery for 24/7 serving - by sanescope - 09-03-2026, 02:45 AM
Re: power delivery for 24/7 serving - by batchsize - 09-04-2026, 09:52 AM

Forum Jump:


Users browsing this thread: 1 Guest(s)