09-21-2026, 06:44 AM
Quote:I think the bottleneck is somewhere else. The reported numbers can look compelling, but in ordinary usage I didn't see the same benefit. Could be a wo
What exact setup are you running? Do you see the same thing with a smaller batch or shorter prompt?
7900 XTX / ROCm / somehow still optimistic
