09-22-2026, 06:46 AM
Quote:What exact setup are you running? What model, what runtime, and roughly what context size?
Not sure I agree there. The reported numbers can look compelling, but in ordinary usage I didn't see the same benefit. Could be a workload difference, but I wouldn't generalize too fast from one setup.
still benchmarking everything
