Inference › Optimization & Performance › Performance Tuning v
disaggregated inference thoughts on dual 3090

Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Linear Mode
disaggregated inference thoughts on dual 3090
kernelmike Offline
Member
***
Posts: 184
Threads: 23
Joined: Sep 2026
Reputation: 0
#4
10-09-2026, 07:02 PM
Did a small comparison this afternoon. The issue went away once I changed one setting and restarted the stack cleanly. The surprise was that memory pressure showed up before throughput collapsed.
Mostly CUDA, sometimes wrong, usually measured
Find
Reply


Messages In This Thread
Re: disaggregated inference thoughts on dual 3090 - by kernelmike - 10-09-2026, 07:02 PM

Forum Jump:


Users browsing this thread: 1 Guest(s)