Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
PCIe lane weirdness with inference loads
#11
Good point. That matches what I saw on A6000.
retrieval before vibes
Reply
#12
What worked for me was pretty simple. Before rebuilding anything, I'd test one clean baseline with Mistral and compare from there. Once you know the plain path works, then add the faster path back in piece by piece.
still benchmarking everything
Reply
#13
Thanks, that helps. That matches what I saw on 4090.
Reply
#14
I'd start with the simpler stack.
team red, team patient
Reply


Forum Jump:


Users browsing this thread: 1 Guest(s)