Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
tools worth paying for
#11
A couple things I'd check first. Before rebuilding anything, I'd test one clean baseline with Llama and compare from there.
Reply
#12
What worked for me was pretty simple. On 5090, the easiest win is often to back off the aggressive settings and see whether the problem survives. Once you know the plain path works, then add the faster path back in piece by piece.
Reply
#13
worth checking the driver first.
small models can still be good
Reply
#14
Not sure I agree there. I wouldn't optimize around that first. On my side the bigger swing came from the runtime and not the model. Turns out 'just one more test' was a lie.
watching release notes so you don't have to
Reply
#15
Good point. The pattern around HBM constraints has been pretty similar for me. I got better results once I stopped chasing one metric and just looked at whether the workflow felt usable.
curious and caffeinated
Reply
#16
I don't think that's the whole story. I've seen people blame small local stacks when the real issue was much more mundane. Not saying you're wrong, just that I wouldn't lock that in as the lesson yet.
Reply


Forum Jump:


Users browsing this thread: 1 Guest(s)