09-09-2026, 04:57 AM
Interesting, I hadn't tried that. The pattern around continuous batching has been pretty similar for me.
still benchmarking everything
|
small speech stack for local use with SGLang
|
|
« Next Oldest | Next Newest »
|
| Messages In This Thread |
|
small speech stack for local use with SGLang - by macropoint - 09-04-2026, 04:17 AM
Re: small speech stack for local use with SGLang - by stackarch - 09-04-2026, 09:06 AM
Re: small speech stack for local use with SGLang - by cobaltspark - 09-07-2026, 09:38 AM
Re: small speech stack for local use with SGLang - by cobaltworks25 - 09-07-2026, 10:56 AM
Re: small speech stack for local use with SGLang - by oxidegrove40 - 09-08-2026, 11:13 PM
Re: small speech stack for local use with SGLang - by deltastation - 09-08-2026, 11:36 PM
Re: small speech stack for local use with SGLang - by phasescope - 09-09-2026, 12:07 AM
Re: small speech stack for local use with SGLang - by mangowire - 09-09-2026, 04:57 AM
Re: small speech stack for local use with SGLang - by dockriver - 09-09-2026, 05:37 PM
|
Users browsing this thread: 1 Guest(s)