paged attention observations with MLX

Thread Rating:

0 Vote(s) - 0 Average
1
2
3
4
5

Linear Mode

paged attention observations with MLX

cacheline Offline

Offline

Senior Member

Posts: 341
Threads: 51
Joined: Sep 2026
Reputation: 0

#3

10-08-2026, 06:57 AM

What exact setup are you running? Are you testing this on 4090 or something else?

measure twice, benchmark three times

Find

Reply

« Next Oldest | Next Newest »

Messages In This Thread

paged attention observations with MLX - by cacheline - 10-05-2026, 05:54 AM

Re: paged attention observations with MLX - by cacheline - 10-06-2026, 06:11 PM

Re: paged attention observations with MLX - by cacheline - 10-08-2026, 06:57 AM

Re: paged attention observations with MLX - by cacheline - 10-08-2026, 07:12 AM

Re: paged attention observations with MLX - by relaysupply90 - 10-08-2026, 07:41 AM

Re: paged attention observations with MLX - by cacheline - 10-08-2026, 09:11 AM

Re: paged attention observations with MLX - by oxidegrove40 - 10-08-2026, 01:52 PM

Re: paged attention observations with MLX - by cacheline - 10-08-2026, 02:16 PM

Re: paged attention observations with MLX - by torchshed - 10-08-2026, 06:18 PM

Re: paged attention observations with MLX - by cacheline - 10-10-2026, 06:39 AM

Re: paged attention observations with MLX - by labline - 10-11-2026, 07:26 PM

Re: paged attention observations with MLX - by cacheline - 10-11-2026, 10:11 PM

Re: paged attention observations with MLX - by vectorpoint - 10-11-2026, 10:24 PM

Re: paged attention observations with MLX - by cacheline - 10-11-2026, 11:36 PM

Re: paged attention observations with MLX - by southtinker - 10-12-2026, 01:47 AM

View a Printable Version

Forum Jump:

Users browsing this thread: 1 Guest(s)