JAX for inference only: what are you seeing?

Thread Rating:

0 Vote(s) - 0 Average
1
2
3
4
5

Linear Mode

JAX for inference only: what are you seeing?

localpatch78 Offline

Offline

Junior Member

Posts: 37
Threads: 3
Joined: Sep 2026
Reputation: 0

#2

09-23-2026, 12:49 AM

Need a little more detail here. Do you see the same thing with a smaller batch or shorter prompt?

If you post your exact settings, people here can probably narrow it down pretty fast.

Find

Reply

« Next Oldest | Next Newest »

Messages In This Thread

JAX for inference only: what are you seeing? - by torchstation - 09-22-2026, 11:57 PM

Re: JAX for inference only: what are you seeing? - by localpatch78 - 09-23-2026, 12:49 AM

Re: JAX for inference only: what are you seeing? - by quantghost - 09-24-2026, 03:48 PM

Re: JAX for inference only: what are you seeing? - by vectorshed43 - 09-23-2026, 09:11 AM

Re: JAX for inference only: what are you seeing? - by stackpilot - 09-24-2026, 09:33 AM

Re: JAX for inference only: what are you seeing? - by batchpeak - 09-24-2026, 10:50 AM

Re: JAX for inference only: what are you seeing? - by orbitbench6 - 09-24-2026, 09:05 PM

Re: JAX for inference only: what are you seeing? - by vectorport - 09-24-2026, 11:30 AM

Re: JAX for inference only: what are you seeing? - by routeforge64 - 09-24-2026, 08:20 PM

Re: JAX for inference only: what are you seeing? - by sanescope - 09-24-2026, 10:35 PM

Re: JAX for inference only: what are you seeing? - by rasterhall - 09-26-2026, 12:41 PM

Re: JAX for inference only: what are you seeing? - by torchdesk - 09-26-2026, 10:30 PM

Re: JAX for inference only: what are you seeing? - by edgecoast - 09-25-2026, 11:22 AM

Re: JAX for inference only: what are you seeing? - by torchshed - 09-26-2026, 12:06 PM

Re: JAX for inference only: what are you seeing? - by prompttinker44 - 09-26-2026, 09:11 PM

Re: JAX for inference only: what are you seeing? - by edgequill - 09-26-2026, 10:08 PM

View a Printable Version

Forum Jump:

Users browsing this thread: 2 Guest(s)