Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
paged attention observations with MLX
#4
Quote:What exact setup are you running? Are you testing this on 4090 or something else?

Interesting, I hadn't tried that. I don't think your conclusion is far off. Worth rechecking your defaults though, because one bad assumption can make the rest of the thread look confusing.
measure twice, benchmark three times
Reply


Messages In This Thread
Re: paged attention observations with MLX - by cacheline - 10-08-2026, 07:12 AM

Forum Jump:


Users browsing this thread: 1 Guest(s)