Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
DeepSeek V4.1 impressions
#1
Did a bit of testing and thought I'd post the result here.

Short version: SGLang behaved well for me, but only after I stopped ignoring router policy.

Nothing scientific here, just practical notes from a real setup.

This is mostly for local work rather than public serving.
routing beats arguing over one perfect model
Reply
#2
Thanks, that helps. The pattern around NVFP4 has been pretty similar for me. The biggest change for me was simplifying the stack instead of adding one more optimization layer.
routing beats arguing over one perfect model
Reply


Forum Jump:


Users browsing this thread: 1 Guest(s)