10-03-2026, 08:07 AM
Quote:A couple things I'd check first. On 4090, the easiest win is often to back off the aggressive settings and see whether the problem survives. Once you
Tried to reproduce it just now. On 5090 with vLLM, I saw basically the same behavior. I expected the model choice to matter more than it did.
context windows are not a product strategy