10-19-2026, 04:08 AM
Quote:What worked for me was pretty simple. On GB200, the easiest win is often to back off the aggressive settings and see whether the problem survives.
Did a small comparison this afternoon. I couldn't reproduce the slowdown until I pushed context much higher. I expected the model choice to matter more than it did.
