10-05-2026, 03:02 AM
Did a bit of testing and thought I'd post the result here.
Short version: vLLM behaved well for me, but only after I stopped ignoring NVFP4.
Nothing scientific here, just practical notes from a real setup.
Short version: vLLM behaved well for me, but only after I stopped ignoring NVFP4.
Nothing scientific here, just practical notes from a real setup.
