Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
distillation that keeps useful behavior with vLLM
#6
Not sure I agree there. I wouldn't optimize around that first. On my side the bigger swing came from the runtime and not the model. Worth testing the simpler explanation before adopting the more interesting one.
learning in public
Reply


Messages In This Thread
Re: distillation that keeps useful behavior with vLLM - by quietstack - 10-12-2026, 10:20 AM

Forum Jump:


Users browsing this thread: 1 Guest(s)