Tensor cores actually helping here with SGLang

Thread Rating:

0 Vote(s) - 0 Average
1
2
3
4
5

Linear Mode

Tensor cores actually helping here with SGLang

dockember Offline

Offline

Member

Posts: 64
Threads: 12
Joined: Sep 2026
Reputation: 0

#10

10-15-2026, 09:33 AM

I tested this tonight. I couldn't reproduce the slowdown until I pushed context much higher.

learning in public

Find

Reply

« Next Oldest | Next Newest »

Messages In This Thread

Tensor cores actually helping here with SGLang - by amberpatch25 - 10-11-2026, 03:31 PM

Re: Tensor cores actually helping here with SGLang - by phaseport36 - 10-12-2026, 12:16 AM

Re: Tensor cores actually helping here with SGLang - by kernelghost - 10-12-2026, 01:40 AM

Re: Tensor cores actually helping here with SGLang - by audiopath66 - 10-13-2026, 02:08 AM

Re: Tensor cores actually helping here with SGLang - by kernelmike - 10-13-2026, 04:24 AM

Re: Tensor cores actually helping here with SGLang - by batchshed - 10-14-2026, 05:11 AM

Re: Tensor cores actually helping here with SGLang - by latentgarden - 10-14-2026, 05:54 AM

Re: Tensor cores actually helping here with SGLang - by cobaltspark - 10-14-2026, 06:41 AM

Re: Tensor cores actually helping here with SGLang - by mintforge - 10-14-2026, 08:51 AM

Re: Tensor cores actually helping here with SGLang - by dockember - 10-15-2026, 09:33 AM

Re: Tensor cores actually helping here with SGLang - by rasterpoint - 10-15-2026, 10:11 AM

Re: Tensor cores actually helping here with SGLang - by bytelab - 10-15-2026, 11:55 AM

View a Printable Version

Forum Jump:

Users browsing this thread: 1 Guest(s)