Inference
NVIDIA driver regression - Printable Version

+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Drivers / Frameworks / Toolkits (https://www.datasculpting.ai/inference/forumdisplay.php?fid=8)
+--- Forum: NVIDIA / CUDA (https://www.datasculpting.ai/inference/forumdisplay.php?fid=31)
+--- Thread: NVIDIA driver regression (/showthread.php?tid=1401)



NVIDIA driver regression - sparrowkite53 - 10-17-2026

Thought I'd post a small recipe because a lot of threads ask similar things.

Maybe useful as a starting point: MLX on 5090, keeping tool calling in mind from the start.

If someone wants the exact settings I can clean them up and post them.


Re: NVIDIA driver regression - mintforge - 10-17-2026

I think the bottleneck is somewhere else. I wouldn't optimize around that first. On my side the bigger swing came from the runtime and not the model.