10-18-2026, 05:49 PM
Ran a quick check on my box. I couldn't reproduce the slowdown until I pushed context much higher. The main thing that moved was latency, not quality.
small models can still be useful
|
new here, what's your stack: early impressions
|
|
« Next Oldest | Next Newest »
|