09-18-2026, 08:19 PM
I tested this tonight. On 5090 with MLX, I saw basically the same behavior. The surprise was that memory pressure showed up before throughput collapsed.
|
long context that stayed useful for Llama
|
|
« Next Oldest | Next Newest »
|