10-04-2026, 12:56 PM
Tried to reproduce it just now. The issue went away once I changed one setting and restarted the stack cleanly. The main thing that moved was latency, not quality.
|
vLLM vs SGLang for small teams on 5090
|
|
« Next Oldest | Next Newest »
|
| Messages In This Thread |
|
vLLM vs SGLang for small teams on 5090 - by oxidemixer - 09-29-2026, 09:06 PM
Re: vLLM vs SGLang for small teams on 5090 - by thetashed24 - 09-29-2026, 10:10 PM
Re: vLLM vs SGLang for small teams on 5090 - by amberrunner - 10-02-2026, 11:46 PM
Re: vLLM vs SGLang for small teams on 5090 - by batchsize - 10-02-2026, 10:56 PM
Re: vLLM vs SGLang for small teams on 5090 - by rocmrunner40 - 10-04-2026, 12:15 PM
Re: vLLM vs SGLang for small teams on 5090 - by oxidemixer - 10-04-2026, 12:56 PM
Re: vLLM vs SGLang for small teams on 5090 - by batchcraft - 10-05-2026, 01:23 PM
|