paged attention observations with MLX

Thread Rating:

0 Vote(s) - 0 Average
1
2
3
4
5

Linear Mode

paged attention observations with MLX

torchshed Offline

Junior Member

Posts: 47
Threads: 6
Joined: Sep 2026
Reputation: 0

10-08-2026, 06:18 PM

Appreciate the detail. I don't think your conclusion is far off. I got better results once I stopped chasing one metric and just looked at whether the workflow felt usable.

Find

« Next Oldest | Next Newest »

Messages In This Thread

paged attention observations with MLX - by cacheline - 10-05-2026, 05:54 AM

Re: paged attention observations with MLX - by cacheline - 10-06-2026, 06:11 PM

Re: paged attention observations with MLX - by cacheline - 10-08-2026, 06:57 AM

Re: paged attention observations with MLX - by cacheline - 10-08-2026, 07:12 AM

Re: paged attention observations with MLX - by relaysupply90 - 10-08-2026, 07:41 AM

Re: paged attention observations with MLX - by cacheline - 10-08-2026, 09:11 AM

Re: paged attention observations with MLX - by oxidegrove40 - 10-08-2026, 01:52 PM

Re: paged attention observations with MLX - by cacheline - 10-08-2026, 02:16 PM

Re: paged attention observations with MLX - by torchshed - 10-08-2026, 06:18 PM

Re: paged attention observations with MLX - by cacheline - 10-10-2026, 06:39 AM

Re: paged attention observations with MLX - by labline - 10-11-2026, 07:26 PM

Re: paged attention observations with MLX - by cacheline - 10-11-2026, 10:11 PM

Re: paged attention observations with MLX - by vectorpoint - 10-11-2026, 10:24 PM

Re: paged attention observations with MLX - by cacheline - 10-11-2026, 11:36 PM

Re: paged attention observations with MLX - by southtinker - 10-12-2026, 01:47 AM

View a Printable Version

Forum Jump:

Users browsing this thread: 2 Guest(s)

Login
Username:
Password:	Lost Password?
	Remember me

Sign in with X.com