10-19-2026, 04:59 AM
Quote:I'd approach it in a boring order. Start by verifying the driver/runtime combo, then test with a smaller prompt, then look at HBM constraints. Not gla
Ran a quick check on my box. On M3 Max with vLLM, I saw basically the same behavior. The surprise was that memory pressure showed up before throughput collapsed.
Apple Silicon • MLX mostly