10-01-2026, 06:56 PM
I'd approach it in a boring order. On GB200, the easiest win is often to back off the aggressive settings and see whether the problem survives.
|
working config for 32k context with SGLang
|
|
« Next Oldest | Next Newest »
|
| Messages In This Thread |
|
working config for 32k context with SGLang - by sparrowhall - 10-01-2026, 05:37 AM
Re: working config for 32k context with SGLang - by kernelgrid - 10-01-2026, 09:48 AM
Re: working config for 32k context with SGLang - by rocmriley - 10-01-2026, 10:49 AM
Re: working config for 32k context with SGLang - by vramstream - 10-01-2026, 11:11 PM
Re: working config for 32k context with SGLang - by cachebench - 10-02-2026, 12:14 PM
Re: working config for 32k context with SGLang - by rasterbench - 10-01-2026, 06:56 PM
Re: working config for 32k context with SGLang - by mangoquill - 10-01-2026, 11:42 PM
|
Users browsing this thread: 1 Guest(s)