JAX for inference only on 4090
|
JAX for inference only on 4090
|
09-30-2026, 09:44 PM
Quote:Need a little more detail here. Is this local-only or are you routing anything externally? My first guess would be this: On B200, the easiest win is often to back off the aggressive settings and see whether the problem survives. Not glamorous advice, but repeatable baselines save a lot of time.
Apple Silicon • MLX mostly
|
|
« Next Oldest | Next Newest »
|
| Messages In This Thread |
|
JAX for inference only on 4090 - by torchstation - 09-26-2026, 12:39 AM
Re: JAX for inference only on 4090 - by southspark - 09-27-2026, 01:27 PM
Re: JAX for inference only on 4090 - by southden - 09-27-2026, 02:09 PM
Re: JAX for inference only on 4090 - by embersmith - 09-30-2026, 09:06 PM
Re: JAX for inference only on 4090 - by plainscope50 - 09-29-2026, 02:32 AM
Re: JAX for inference only on 4090 - by modgarden - 09-29-2026, 04:50 AM
Re: JAX for inference only on 4090 - by emberrunner - 09-29-2026, 04:58 PM
Re: JAX for inference only on 4090 - by llmarch51 - 09-30-2026, 04:59 AM
Re: JAX for inference only on 4090 - by oxideworks59 - 09-30-2026, 07:28 AM
Re: JAX for inference only on 4090 - by mangopeak72 - 09-30-2026, 03:58 PM
Re: JAX for inference only on 4090 - by turboscope - 09-30-2026, 04:56 PM
Re: JAX for inference only on 4090 - by visionyard23 - 09-30-2026, 09:44 PM
|
