09-22-2026, 04:28 PM
Did a small comparison this afternoon. I couldn't reproduce the slowdown until I pushed context much higher. The surprise was that memory pressure showed up before throughput collapsed.
|
student models for local use: worth it?
|
|
« Next Oldest | Next Newest »
|