10-18-2026, 09:04 PM
Tried to reproduce it just now. I couldn't reproduce the slowdown until I pushed context much higher. The surprise was that memory pressure showed up before throughput collapsed.
|
distillation that keeps useful behavior: anyone testing this?
|
|
« Next Oldest | Next Newest »
|
| Messages In This Thread |
|
distillation that keeps useful behavior: anyone testing this? - by thetaplane - 10-18-2026, 06:49 PM
Re: distillation that keeps useful behavior: anyone testing this? - by mangowire - 10-18-2026, 05:12 PM
Re: distillation that keeps useful behavior: anyone testing this? - by quietstack - 10-18-2026, 05:18 PM
Re: distillation that keeps useful behavior: anyone testing this? - by emberpeak - 10-18-2026, 08:12 PM
Re: distillation that keeps useful behavior: anyone testing this? - by amberpatch25 - 10-18-2026, 09:04 PM
Re: distillation that keeps useful behavior: anyone testing this? - by llmtrack26 - 10-18-2026, 09:01 PM
Re: distillation that keeps useful behavior: anyone testing this? - by torchkite - 10-19-2026, 04:01 AM
Re: distillation that keeps useful behavior: anyone testing this? - by turboyard94 - 10-19-2026, 05:31 AM
|