10-14-2026, 11:12 AM
My first guess would be this: On 4090, the easiest win is often to back off the aggressive settings and see whether the problem survives.
curious and caffeinated
|
hybrid retrieval results
|
|
10-14-2026, 11:12 AM
My first guess would be this: On 4090, the easiest win is often to back off the aggressive settings and see whether the problem survives.
curious and caffeinated
10-14-2026, 01:22 PM
Tried to reproduce it just now. I couldn't reproduce the slowdown until I pushed context much higher.
10-14-2026, 02:26 PM
Did a small comparison this afternoon. The issue went away once I changed one setting and restarted the stack cleanly. The surprise was that memory pressure showed up before throughput collapsed.
|
|
« Next Oldest | Next Newest »
|