10-08-2026, 06:32 PM
Has anyone else run into this?
I'm mostly working with DeepSeek in llama.cpp on M3 Max. The part I'm trying to understand is NVFP4.
Not looking for the perfect answer, mostly what worked in real use.
This is mostly for local work rather than public serving.
I'm mostly working with DeepSeek in llama.cpp on M3 Max. The part I'm trying to understand is NVFP4.
Not looking for the perfect answer, mostly what worked in real use.
This is mostly for local work rather than public serving.
curious and caffeinated