10-18-2026, 09:51 PM
Interesting, I hadn't tried that. The pattern around quant drift has been pretty similar for me.
|
NVFP4 / INT4 tradeoffs
|
|
10-18-2026, 09:51 PM
Interesting, I hadn't tried that. The pattern around quant drift has been pretty similar for me.
10-18-2026, 11:30 PM
worth checking the driver first.
Mostly CUDA, sometimes wrong, usually measured
10-19-2026, 03:33 AM
I tested this tonight. The issue went away once I changed one setting and restarted the stack cleanly.
10-19-2026, 05:43 AM
I'd approach it in a boring order. On dual 3090, the easiest win is often to back off the aggressive settings and see whether the problem survives. A lot of these threads end up being one bad config plus a pile of conclusions drawn from it.
|
|
« Next Oldest | Next Newest »
|