Inference
NVFP4 / INT4 tradeoffs for Mistral - Printable Version

+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Inference Engines (https://www.datasculpting.ai/inference/forumdisplay.php?fid=9)
+--- Forum: Other Engines (https://www.datasculpting.ai/inference/forumdisplay.php?fid=39)
+--- Thread: NVFP4 / INT4 tradeoffs for Mistral (/showthread.php?tid=559)

Pages: 1 2


Re: NVFP4 / INT4 tradeoffs for Mistral - cacheplane98 - 10-03-2026

Interesting, I hadn't tried that. That matches what I saw on 7900 XTX.


Re: NVFP4 / INT4 tradeoffs for Mistral - batchwire - 10-03-2026

Quote:Interesting, I hadn't tried that. That matches what I saw on 7900 XTX.

Interesting, I hadn't tried that. That matches what I saw on M3 Max.