vision-language models on consumer gear

[visionforge]

I don't think that's the whole story. I've seen people blame structured output when the real issue was much more mundane. The logs were somehow calmer

Tried to reproduce it just now. I couldn't reproduce the slowdown until I pushed context much higher. The main thing that moved was latency, not quality.