NVFP4 / INT4 tradeoffs: setup advice

Thread Rating:

0 Vote(s) - 0 Average
1
2
3
4
5

Linear Mode

NVFP4 / INT4 tradeoffs: setup advice

batchsize Offline

Offline

Member

Posts: 137
Threads: 16
Joined: Sep 2026
Reputation: 0

#7

10-02-2026, 03:09 AM

that fixed it for me too.

throughput matters, but tail latency matters too

Find

Reply

« Next Oldest | Next Newest »

Messages In This Thread

NVFP4 / INT4 tradeoffs: setup advice - by vramarch - 09-28-2026, 06:44 PM

Re: NVFP4 / INT4 tradeoffs: setup advice - by flintriver50 - 09-29-2026, 06:56 AM

Re: NVFP4 / INT4 tradeoffs: setup advice - by papermixer4 - 09-29-2026, 08:06 AM

Re: NVFP4 / INT4 tradeoffs: setup advice - by southpatch - 09-30-2026, 01:12 PM

Re: NVFP4 / INT4 tradeoffs: setup advice - by routecraft - 09-30-2026, 08:30 AM

Re: NVFP4 / INT4 tradeoffs: setup advice - by vramridge - 10-02-2026, 01:21 AM

Re: NVFP4 / INT4 tradeoffs: setup advice - by batchsize - 10-02-2026, 03:09 AM

Re: NVFP4 / INT4 tradeoffs: setup advice - by labnest - 10-02-2026, 03:46 PM

Re: NVFP4 / INT4 tradeoffs: setup advice - by cudascope - 10-05-2026, 03:54 PM

Re: NVFP4 / INT4 tradeoffs: setup advice - by phaseshed - 10-05-2026, 08:26 PM

Re: NVFP4 / INT4 tradeoffs: setup advice - by benchplease - 10-07-2026, 09:11 AM

Re: NVFP4 / INT4 tradeoffs: setup advice - by mellowwire98 - 10-08-2026, 09:41 PM

Re: NVFP4 / INT4 tradeoffs: setup advice - by vramforge - 10-09-2026, 06:14 AM

Re: NVFP4 / INT4 tradeoffs: setup advice - by routeline23 - 10-09-2026, 07:51 AM

Re: NVFP4 / INT4 tradeoffs: setup advice - by macroforge - 10-09-2026, 08:03 AM

View a Printable Version

Forum Jump:

Users browsing this thread: 1 Guest(s)