|
long context that stayed useful
|
09-21-2026, 04:07 PM
Tried to reproduce it just now. I couldn't reproduce the slowdown until I pushed context much higher. The surprise was that memory pressure showed up before throughput collapsed.
I'm happy to test one more variant if you want a second data point.
context windows are not a product strategy
|
|
« Next Oldest | Next Newest »
|
| Messages In This Thread |
|
long context that stayed useful - by emberquill - 09-17-2026, 02:33 PM
Re: long context that stayed useful - by oxideworks59 - 09-17-2026, 02:46 PM
Re: long context that stayed useful - by vrampilot - 09-19-2026, 03:16 AM
Re: long context that stayed useful - by vectorpoint - 09-25-2026, 06:36 PM
Re: long context that stayed useful - by circuitwire58 - 09-20-2026, 04:02 PM
Re: long context that stayed useful - by tinycontext - 09-21-2026, 04:07 PM
Re: long context that stayed useful - by quantghost - 09-21-2026, 05:27 PM
Re: long context that stayed useful - by torchstation - 09-22-2026, 06:06 PM
Re: long context that stayed useful - by sanescope - 09-26-2026, 03:23 AM
|
