Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
NVFP4 / INT4 tradeoffs for Llama
#3
Did a small comparison this afternoon. The issue went away once I changed one setting and restarted the stack cleanly. The main thing that moved was latency, not quality.

If you post your exact settings, people here can probably narrow it down pretty fast.
Reply


Messages In This Thread
Re: NVFP4 / INT4 tradeoffs for Llama - by fastfield4 - 09-29-2026, 11:26 PM

Forum Jump:


Users browsing this thread: 1 Guest(s)