Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
paged attention observations
#5
Quote:A couple things I'd check first. Before rebuilding anything, I'd test one clean baseline with Kimi and compare from there. A lot of these threads end

My first guess would be this: If you're on llama.cpp, I'd confirm the version first and then reduce variables until the behavior is obvious. Once you know the plain path works, then add the faster path back in piece by piece.
image models by night, local pipelines by day
Reply


Messages In This Thread
paged attention observations - by cobalttinker - 09-29-2026, 02:56 PM
Re: paged attention observations - by cacheline - 09-30-2026, 03:29 AM
Re: paged attention observations - by dockriver - 10-01-2026, 04:14 AM
Re: paged attention observations - by cacheline - 10-01-2026, 04:50 PM
Re: paged attention observations - by visionforge - 10-01-2026, 05:08 PM
Re: paged attention observations - by cacheline - 10-01-2026, 06:40 PM
Re: paged attention observations - by cacheline - 10-01-2026, 08:17 PM
Re: paged attention observations - by circuitkite - 10-02-2026, 04:21 AM
Re: paged attention observations - by oxidemixer - 10-05-2026, 04:29 AM
Re: paged attention observations - by cacheline - 10-05-2026, 05:35 AM

Forum Jump:


Users browsing this thread: 1 Guest(s)