+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Inference Engines (https://www.datasculpting.ai/inference/forumdisplay.php?fid=9)
+--- Forum: Other Engines (https://www.datasculpting.ai/inference/forumdisplay.php?fid=39)
+--- Thread: NVFP4 / INT4 tradeoffs (/showthread.php?tid=1202)
NVFP4 / INT4 tradeoffs - cozykite - 10-14-2026
Posting this in case it saves someone else a little time.
I'm helping a small team set up a local workflow. We don't need a giant stack, but we do care about VRAM headroom.
Simple and boring is a valid answer.
My use case is pretty ordinary: local chat, some document work, and occasional batch jobs.
The part that surprised me was how much the boring details mattered more than the model choice.
Re: NVFP4 / INT4 tradeoffs - northhall88 - 10-14-2026
A couple things I'd check first. On B200, the easiest win is often to back off the aggressive settings and see whether the problem survives.