09-30-2026, 08:48 PM
Did a small comparison this afternoon. On 7900 XTX with Ollama, I saw basically the same behavior. The surprise was that memory pressure showed up before throughput collapsed.
curious and caffeinated
|
memory layers vs plain long context: setup advice
|
|
« Next Oldest | Next Newest »
|