Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
paged attention observations for Mistral
#12
Quote:I'd approach it in a boring order. On mini PC, the easiest win is often to back off the aggressive settings and see whether the problem survives. Not

What exact setup are you running? Do you see the same thing with a smaller batch or shorter prompt?
measure twice, benchmark three times
Reply


Messages In This Thread
Re: paged attention observations for Mistral - by cacheline - 10-19-2026, 03:37 AM

Forum Jump:


Users browsing this thread: 1 Guest(s)