10-03-2026, 01:32 AM
Quote:A couple questions before I guess too hard. What model, what runtime, and roughly what context size?
Need a little more detail here. Do you see the same thing with a smaller batch or shorter prompt?
trying not to rebuild again