Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
mobile NPU reality check with PyTorch
#1
This keeps coming up in conversation so I figured I'd start a thread.

The more I work with local setups, the more it seems like INT4 decides everything downstream.

Maybe obvious to some of you, but it clicked for me this week.

This is mostly for local work rather than public serving.
Reply


Forum Jump:


Users browsing this thread: 1 Guest(s)