10-19-2026, 12:00 AM
Did a small comparison this afternoon. On A6000 with TensorRT-LLM, I saw basically the same behavior. I expected the model choice to matter more than it did.
measure twice, benchmark three times
|
paged attention observations
|
|
« Next Oldest | Next Newest »
|
| Messages In This Thread |
|
paged attention observations - by cacheline - 10-18-2026, 02:16 AM
Re: paged attention observations - by edgecoast - 10-18-2026, 06:02 PM
Re: paged attention observations - by cacheline - 10-19-2026, 12:00 AM
Re: paged attention observations - by dockkite69 - 10-18-2026, 07:34 PM
Re: paged attention observations - by cacheline - 10-18-2026, 08:50 PM
Re: paged attention observations - by sanepeak48 - 10-18-2026, 10:19 PM
Re: paged attention observations - by cacheline - 10-19-2026, 04:03 AM
Re: paged attention observations - by quantnest - 10-19-2026, 04:41 AM
Re: paged attention observations - by cacheline - 10-19-2026, 05:31 AM
|
Users browsing this thread: 1 Guest(s)