Inference › Hardware › GPUs v
PCIe lane weirdness with inference loads

Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Threaded Mode
PCIe lane weirdness with inference loads
amberhall Offline
Member
***
Posts: 58
Threads: 6
Joined: Sep 2026
Reputation: 0
#11
10-17-2026, 11:33 AM
Tried to reproduce it just now. My result was mixed: first run looked bad, second run looked normal. The surprise was that memory pressure showed up before throughput collapsed.
Find
Reply
kernelmike Offline
Member
***
Posts: 184
Threads: 23
Joined: Sep 2026
Reputation: 0
#12
10-17-2026, 12:43 PM
Quote:Tried to reproduce it just now. My result was mixed: first run looked bad, second run looked normal. The surprise was that memory pressure showed up b

Need a little more detail here. Do you see the same thing with a smaller batch or shorter prompt?
Mostly CUDA, sometimes wrong, usually measured
Find
Reply


Forum Jump:


Users browsing this thread: 1 Guest(s)