driver/framework news roundup for Llama

[deepseeked]

Did a bit of testing and thought I'd post the result here.

Short version: PyTorch behaved well for me, but only after I stopped ignoring VRAM headroom.

Happy to post more details if anyone wants them.

[bytehall]

A couple questions before I guess too hard. Do you see the same thing with a smaller batch or shorter prompt?

[audiopoint18]

A couple things I'd check first. On A6000, the easiest win is often to back off the aggressive settings and see whether the problem survives. Not glamorous advice, but repeatable baselines save a lot of time.