10-09-2026, 02:07 AM
Did a small comparison this afternoon. I couldn't reproduce the slowdown until I pushed context much higher. The surprise was that memory pressure showed up before throughput collapsed.
|
Apple unified memory limits with vLLM
|
|
« Next Oldest | Next Newest »
|
Users browsing this thread: 1 Guest(s)