Inference › Optimization & Performance › Context / KV Cache v
paged attention observations

Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Linear Mode
paged attention observations
cacheline Offline
Senior Member
****
Posts: 341
Threads: 51
Joined: Sep 2026
Reputation: 0
#4
10-18-2026, 08:50 PM
Quote:That matches what I was seeing. The pattern around quant drift has been pretty similar for me. I got better results once I stopped chasing one metric

following this because I'm in the same boat.
measure twice, benchmark three times
Find
Reply


Messages In This Thread
paged attention observations - by cacheline - 10-18-2026, 02:16 AM
Re: paged attention observations - by edgecoast - 10-18-2026, 06:02 PM
Re: paged attention observations - by cacheline - 10-19-2026, 12:00 AM
Re: paged attention observations - by dockkite69 - 10-18-2026, 07:34 PM
Re: paged attention observations - by cacheline - 10-18-2026, 08:50 PM
Re: paged attention observations - by sanepeak48 - 10-18-2026, 10:19 PM
Re: paged attention observations - by cacheline - 10-19-2026, 04:03 AM
Re: paged attention observations - by quantnest - 10-19-2026, 04:41 AM
Re: paged attention observations - by cacheline - 10-19-2026, 05:31 AM

Forum Jump:


Users browsing this thread: 1 Guest(s)