few-shot when you actually need it

[batchember]

My first guess would be this: If you're on PyTorch, I'd confirm the version first and then reduce variables until the behavior is obvious.

[quantyard]

Good point. That matches what I saw on mini PC. The biggest change for me was simplifying the stack instead of adding one more optimization layer.

[mlxgarden]

Can you fill in a bit more context? Is this local-only or are you routing anything externally?

[nanopatch]

What worked for me was pretty simple. On 7900 XTX, the easiest win is often to back off the aggressive settings and see whether the problem survives.