10-13-2026, 01:13 AM
Did a small comparison this afternoon. I couldn't reproduce the slowdown until I pushed context much higher. The surprise was that memory pressure showed up before throughput collapsed.
|
TensorRT-LLM worth the setup time with SGLang
|
|
« Next Oldest | Next Newest »
|
| Messages In This Thread |
|
TensorRT-LLM worth the setup time with SGLang - by torchshed66 - 10-09-2026, 05:28 PM
Re: TensorRT-LLM worth the setup time with SGLang - by macrotinker - 10-11-2026, 05:54 AM
Re: TensorRT-LLM worth the setup time with SGLang - by northcraft90 - 10-12-2026, 06:36 PM
Re: TensorRT-LLM worth the setup time with SGLang - by northgrid33 - 10-12-2026, 07:45 PM
Re: TensorRT-LLM worth the setup time with SGLang - by routecrate - 10-12-2026, 08:21 PM
Re: TensorRT-LLM worth the setup time with SGLang - by macrotinker - 10-12-2026, 08:56 PM
Re: TensorRT-LLM worth the setup time with SGLang - by kernelgrid - 10-13-2026, 01:13 AM
|
Users browsing this thread: 1 Guest(s)