Inference › Optimization & Performance › Context / KV Cache v
paged attention observations

Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Linear Mode
paged attention observations
cacheline Offline
Senior Member
****
Posts: 341
Threads: 51
Joined: Sep 2026
Reputation: 0
#3
10-04-2026, 06:37 AM
Quote:that fixed it for me too.

Thanks, that helps. The pattern around NVFP4 has been pretty similar for me. Worth rechecking your defaults though, because one bad assumption can make the rest of the thread look confusing.
measure twice, benchmark three times
Find
Reply


Messages In This Thread
paged attention observations - by cacheline - 10-04-2026, 03:38 AM
Re: paged attention observations - by quantyard - 10-04-2026, 04:10 AM
Re: paged attention observations - by cacheline - 10-04-2026, 06:37 AM
Re: paged attention observations - by cacheline - 10-05-2026, 08:10 PM
Re: paged attention observations - by fusedriver - 10-06-2026, 08:43 AM
Re: paged attention observations - by cacheline - 10-06-2026, 09:19 AM

Forum Jump:


Users browsing this thread: 1 Guest(s)