10-14-2026, 01:14 PM
I tested this tonight. I couldn't reproduce the slowdown until I pushed context much higher. The surprise was that memory pressure showed up before throughput collapsed.
|
long context that stayed useful: anyone testing this?
|
|
« Next Oldest | Next Newest »
|