Apple unified memory limits with vLLM

Thread Rating:

0 Vote(s) - 0 Average
1
2
3
4
5

Linear Mode

Apple unified memory limits with vLLM

mlxgarden Offline

Offline

Member

Posts: 199
Threads: 27
Joined: Sep 2026
Reputation: 0

#3

10-08-2026, 12:40 PM

Ran a quick check on my box. I couldn't reproduce the slowdown until I pushed context much higher.

M3 Max • MLX • local-first

Find

Reply

« Next Oldest | Next Newest »

Messages In This Thread

Apple unified memory limits with vLLM - by mlxgarden - 10-06-2026, 03:53 PM

Re: Apple unified memory limits with vLLM - by dockridge - 10-07-2026, 12:08 AM

Re: Apple unified memory limits with vLLM - by mlxgarden - 10-08-2026, 12:40 PM

Re: Apple unified memory limits with vLLM - by plainember52 - 10-08-2026, 12:57 PM

Re: Apple unified memory limits with vLLM - by dockridge - 10-08-2026, 01:33 PM

Re: Apple unified memory limits with vLLM - by thetaarch43 - 10-08-2026, 05:37 PM

Re: Apple unified memory limits with vLLM - by torchdesk - 10-09-2026, 02:07 AM

Re: Apple unified memory limits with vLLM - by batchsize - 10-09-2026, 02:44 PM

Re: Apple unified memory limits with vLLM - by cobaltlab - 10-10-2026, 03:11 PM

Re: Apple unified memory limits with vLLM - by cudacrate - 10-10-2026, 04:28 PM

Re: Apple unified memory limits with vLLM - by mlxgarden - 10-13-2026, 11:52 PM

Re: Apple unified memory limits with vLLM - by visionyard23 - 10-13-2026, 05:05 PM

Re: Apple unified memory limits with vLLM - by dockridge - 10-13-2026, 09:08 PM

Re: Apple unified memory limits with vLLM - by sanescope - 10-14-2026, 01:54 AM

View a Printable Version

Forum Jump:

Users browsing this thread: 1 Guest(s)