09-30-2026, 08:01 PM
Did a small comparison this afternoon. On 4090 with vLLM, I saw basically the same behavior. The surprise was that memory pressure showed up before throughput collapsed.
|
desktop apps around local AI on 5090
|
|
« Next Oldest | Next Newest »
|