Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Tensor cores actually helping here with SGLang
#1
I'm trying to sanity-check my setup.

My current setup is SGLang with B200, and I keep running into long context.

If you've tested something similar, what did you keep and what did you stop bothering with?

This is mostly for local work rather than public serving.
Reply


Messages In This Thread
Tensor cores actually helping here with SGLang - by amberpatch25 - 10-11-2026, 03:31 PM

Forum Jump:


Users browsing this thread: 1 Guest(s)