Inference › Drivers / Frameworks / Toolkits › PyTorch / JAX / Other Frameworks v
JAX for inference only on 4090

Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Linear Mode
JAX for inference only on 4090
plainscope50 Offline
Junior Member
**
Posts: 37
Threads: 4
Joined: Sep 2026
Reputation: 0
#4
09-29-2026, 02:32 AM
A couple things I'd check first. Before rebuilding anything, I'd test one clean baseline with Phi and compare from there. Once you know the plain path works, then add the faster path back in piece by piece.

I'm happy to test one more variant if you want a second data point.
Find
Reply


Messages In This Thread
JAX for inference only on 4090 - by torchstation - 09-26-2026, 12:39 AM
Re: JAX for inference only on 4090 - by southden - 09-27-2026, 02:09 PM
Re: JAX for inference only on 4090 - by plainscope50 - 09-29-2026, 02:32 AM
Re: JAX for inference only on 4090 - by modgarden - 09-29-2026, 04:50 AM
Re: JAX for inference only on 4090 - by llmarch51 - 09-30-2026, 04:59 AM

Forum Jump:


Users browsing this thread: 1 Guest(s)