paged attention observations for Mistral

Thread Rating:

0 Vote(s) - 0 Average
1
2
3
4
5

Linear Mode

paged attention observations for Mistral

cacheline Offline

Senior Member

Posts: 341
Threads: 51
Joined: Sep 2026
Reputation: 0

10-18-2026, 07:46 PM

Appreciate the detail. The pattern around VRAM headroom has been pretty similar for me. I got better results once I stopped chasing one metric and just looked at whether the workflow felt usable.

measure twice, benchmark three times

Find

« Next Oldest | Next Newest »

Messages In This Thread

paged attention observations for Mistral - by cacheline - 10-16-2026, 06:31 AM

Re: paged attention observations for Mistral - by cacheline - 10-16-2026, 03:17 PM

Re: paged attention observations for Mistral - by cacheline - 10-18-2026, 08:30 AM

Re: paged attention observations for Mistral - by vramarch - 10-18-2026, 03:57 AM

Re: paged attention observations for Mistral - by cacheline - 10-18-2026, 07:46 PM

Re: paged attention observations for Mistral - by cacheline - 10-18-2026, 09:58 PM

Re: paged attention observations for Mistral - by kernelmike - 10-18-2026, 10:02 PM

Re: paged attention observations for Mistral - by cacheline - 10-19-2026, 12:47 AM

Re: paged attention observations for Mistral - by oxiderunner - 10-19-2026, 01:30 AM

Re: paged attention observations for Mistral - by labline - 10-19-2026, 02:35 AM

Re: paged attention observations for Mistral - by cacheline - 10-19-2026, 03:37 AM

Re: paged attention observations for Mistral - by edgekite - 10-19-2026, 04:17 AM

View a Printable Version

Forum Jump:

Users browsing this thread: 1 Guest(s)

Login
Username:
Password:	Lost Password?
	Remember me

Sign in with X.com