09-20-2026, 07:33 PM
Not sure I agree there. The reported numbers can look compelling, but in ordinary usage I didn't see the same benefit. Could be a workload difference, but I wouldn't generalize too fast from one setup.
|
prefill bottlenecks on longer prompts for Mistral
|
|
« Next Oldest | Next Newest »
|
Users browsing this thread: 1 Guest(s)