10-07-2026, 04:43 PM
Tried to reproduce it just now. I couldn't reproduce the slowdown until I pushed context much higher. The surprise was that memory pressure showed up before throughput collapsed.
|
clean API wrappers for local agents for Qwen
|
|
« Next Oldest | Next Newest »
|
Users browsing this thread: 1 Guest(s)