Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
working config for 32k context
#3
Quote:Appreciate the detail. The pattern around tail latency has been pretty similar for me. Worth rechecking your defaults though, because one bad assumpti

What worked for me was pretty simple. On GB200, the easiest win is often to back off the aggressive settings and see whether the problem survives. Once you know the plain path works, then add the faster path back in piece by piece.
7900 XTX / ROCm / somehow still optimistic
Reply


Messages In This Thread
working config for 32k context - by mintstation99 - 10-04-2026, 12:34 AM
Re: working config for 32k context - by rocmriley - 10-05-2026, 02:07 AM
Re: working config for 32k context - by llmpeak - 10-05-2026, 05:26 AM
Re: working config for 32k context - by deltagrid - 10-05-2026, 07:00 AM
Re: working config for 32k context - by rocmriley - 10-05-2026, 11:37 AM
Re: working config for 32k context - by modgarden - 10-05-2026, 12:19 PM
Re: working config for 32k context - by rocmriley - 10-06-2026, 01:58 PM

Forum Jump:


Users browsing this thread: 1 Guest(s)