![]() |
|
NVFP4 / INT4 tradeoffs - Printable Version +- Inference (https://www.datasculpting.ai/inference) +-- Forum: Inference Engines (https://www.datasculpting.ai/inference/forumdisplay.php?fid=9) +--- Forum: Other Engines (https://www.datasculpting.ai/inference/forumdisplay.php?fid=39) +--- Thread: NVFP4 / INT4 tradeoffs (/showthread.php?tid=1227) Pages:
1
2
|
Re: NVFP4 / INT4 tradeoffs - sparrowcraft - 10-18-2026 Interesting, I hadn't tried that. The pattern around quant drift has been pretty similar for me. Re: NVFP4 / INT4 tradeoffs - kernelmike - 10-18-2026 worth checking the driver first. Re: NVFP4 / INT4 tradeoffs - sparrowhall - 10-19-2026 I tested this tonight. The issue went away once I changed one setting and restarted the stack cleanly. Re: NVFP4 / INT4 tradeoffs - quantyard - 10-19-2026 I'd approach it in a boring order. On dual 3090, the easiest win is often to back off the aggressive settings and see whether the problem survives. A lot of these threads end up being one bad config plus a pile of conclusions drawn from it. |