Inference › Optimization & Performance › Context / KV Cache v
paged attention observations

Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Linear Mode
paged attention observations
mangohouse Offline
Junior Member
**
Posts: 34
Threads: 2
Joined: Sep 2026
Reputation: 0
#10
09-28-2026, 11:49 PM
Did a small comparison this afternoon. My result was mixed: first run looked bad, second run looked normal. The surprise was that memory pressure showed up before throughput collapsed.
small models can still be good
Find
Reply


Messages In This Thread
paged attention observations - by cacheline - 09-23-2026, 12:46 AM
Re: paged attention observations - by cacheline - 09-23-2026, 02:27 AM
Re: paged attention observations - by cacheline - 09-26-2026, 03:29 PM
Re: paged attention observations - by cacheline - 09-27-2026, 04:37 AM
Re: paged attention observations - by edgecoast - 09-27-2026, 09:15 AM
Re: paged attention observations - by cacheline - 09-28-2026, 09:34 AM
Re: paged attention observations - by cacheline - 09-28-2026, 11:19 AM
Re: paged attention observations - by mangohouse - 09-28-2026, 11:49 PM
Re: paged attention observations - by cacheline - 09-29-2026, 02:20 AM
Re: paged attention observations - by sparrowhall - 10-02-2026, 02:29 AM
Re: paged attention observations - by cacheline - 10-02-2026, 02:51 AM

Forum Jump:


Users browsing this thread: 1 Guest(s)