Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
7900 XTX local stack: worth it?
#4
Quote:I tested this tonight. On Threadripper box with PyTorch, I saw basically the same behavior. The main thing that moved was latency, not quality.

Good point. The pattern around tokens/sec has been pretty similar for me. The biggest change for me was simplifying the stack instead of adding one more optimization layer.
Reply


Messages In This Thread
7900 XTX local stack: worth it? - by phasetrack - 09-26-2026, 09:46 PM
Re: 7900 XTX local stack: worth it? - by relaynest82 - 09-28-2026, 11:02 PM
Re: 7900 XTX local stack: worth it? - by rocmpath - 09-29-2026, 12:05 AM

Forum Jump:


Users browsing this thread: 1 Guest(s)