Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
distillation that keeps useful behavior with vLLM
#5
That matches what I was seeing. I ended up in about the same place using SGLang. Worth rechecking your defaults though, because one bad assumption can make the rest of the thread look confusing.
Reply


Messages In This Thread
Re: distillation that keeps useful behavior with vLLM - by turboyard94 - 10-12-2026, 08:55 AM

Forum Jump:


Users browsing this thread: 1 Guest(s)