non-AI thing you built recently

[lablab]

Need a little more detail here. What model, what runtime, and roughly what context size?

Tried to reproduce it just now. The issue went away once I changed one setting and restarted the stack cleanly. The main thing that moved was latency, not quality.