10-19-2026, 04:21 AM
Ran a quick check on my box. I couldn't reproduce the slowdown until I pushed context much higher. The main thing that moved was latency, not quality.
measure twice, benchmark three times
|
prefix caching on repeated workflows
|
|
« Next Oldest | Next Newest »
|