Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
paged attention observations
#1
I figured I'd ask here before changing everything.

I'm mostly working with Qwen in MLX on GB200. The part I'm trying to understand is NVFP4.

If you've tested something similar, what did you keep and what did you stop bothering with?

For context, I'm not chasing leaderboard numbers. I mostly want the system to feel consistent day to day.
measure twice, benchmark three times
Reply


Messages In This Thread
paged attention observations - by cacheline - 09-23-2026, 12:46 AM
Re: paged attention observations - by cacheline - 09-23-2026, 02:27 AM
Re: paged attention observations - by cacheline - 09-26-2026, 03:29 PM
Re: paged attention observations - by cacheline - 09-27-2026, 04:37 AM
Re: paged attention observations - by edgecoast - 09-27-2026, 09:15 AM
Re: paged attention observations - by cacheline - 09-28-2026, 09:34 AM
Re: paged attention observations - by cacheline - 09-28-2026, 11:19 AM
Re: paged attention observations - by mangohouse - 09-28-2026, 11:49 PM
Re: paged attention observations - by cacheline - 09-29-2026, 02:20 AM
Re: paged attention observations - by sparrowhall - 10-02-2026, 02:29 AM
Re: paged attention observations - by cacheline - 10-02-2026, 02:51 AM

Forum Jump:


Users browsing this thread: 1 Guest(s)