Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Apple unified memory limits with vLLM
#1
Maybe I'm missing something obvious.

I'm mostly working with Phi in llama.cpp on GB200. The part I'm trying to understand is NVFP4.

Would appreciate practical advice rather than theory.
M3 Max • MLX • local-first
Reply


Messages In This Thread
Apple unified memory limits with vLLM - by mlxgarden - 10-06-2026, 03:53 PM

Forum Jump:


Users browsing this thread: 1 Guest(s)