10-11-2026, 09:10 AM
What worked for me was pretty simple. Start by verifying the driver/runtime combo, then test with a smaller prompt, then look at HBM constraints.
|
working config for 32k context with SGLang
|
|
« Next Oldest | Next Newest »
|
| Messages In This Thread |
|
working config for 32k context with SGLang - by visionforge - 10-10-2026, 07:12 PM
Re: working config for 32k context with SGLang - by rocmhouse90 - 10-10-2026, 09:24 PM
Re: working config for 32k context with SGLang - by audioriver - 10-11-2026, 05:31 AM
Re: working config for 32k context with SGLang - by llmpeak - 10-11-2026, 07:22 AM
Re: working config for 32k context with SGLang - by audioriver - 10-11-2026, 08:06 AM
Re: working config for 32k context with SGLang - by sparrowbrook - 10-11-2026, 08:58 AM
Re: working config for 32k context with SGLang - by llmpeak - 10-11-2026, 09:10 AM
Re: working config for 32k context with SGLang - by modgarden - 10-11-2026, 11:39 AM
Re: working config for 32k context with SGLang - by rocmriley - 10-12-2026, 12:11 AM
Re: working config for 32k context with SGLang - by audionode8 - 10-12-2026, 04:20 AM
|
Users browsing this thread: 1 Guest(s)