10-13-2026, 02:09 PM
Quote:Need a little more detail here. Do you see the same thing with a smaller batch or shorter prompt?
A couple questions before I guess too hard. Is this local-only or are you routing anything externally?
Mostly CUDA, sometimes wrong, usually measured