+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Drivers / Frameworks / Toolkits (https://www.datasculpting.ai/inference/forumdisplay.php?fid=8)
+--- Forum: PyTorch / JAX / Other Frameworks (https://www.datasculpting.ai/inference/forumdisplay.php?fid=34)
+--- Thread: JAX for inference only on 4090 (/showthread.php?tid=494)
Pages:
1
2
Re: JAX for inference only on 4090 - embersmith - 09-30-2026
Need a little more detail here. Is this local-only or are you routing anything externally?
Re: JAX for inference only on 4090 - visionyard23 - 09-30-2026
Quote:Need a little more detail here. Is this local-only or are you routing anything externally?
My first guess would be this: On B200, the easiest win is often to back off the aggressive settings and see whether the problem survives. Not glamorous advice, but repeatable baselines save a lot of time.