Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
CUDA update broke my throughput
#11
worth checking the driver first.

If you post your exact settings, people here can probably narrow it down pretty fast.
Reply
#12
worth checking the driver first.
Reply
#13
That matches what I was seeing. I don't think your conclusion is far off. I got better results once I stopped chasing one metric and just looked at whether the workflow felt usable.
Reply
#14
Good point. I don't think your conclusion is far off. The biggest change for me was simplifying the stack instead of adding one more optimization layer.

If you post your exact settings, people here can probably narrow it down pretty fast.
small models can still be good
Reply


Forum Jump:


Users browsing this thread: 1 Guest(s)