JAX for inference only: what are you seeing?

Thread Rating:

0 Vote(s) - 0 Average
1
2
3
4
5

Linear Mode

JAX for inference only: what are you seeing?

orbitbench6 Offline

Offline

Member

Posts: 60
Threads: 5
Joined: Sep 2026
Reputation: 0

#9

09-24-2026, 09:05 PM

Tried to reproduce it just now. On 4090 with Ollama, I saw basically the same behavior. I expected the model choice to matter more than it did.

Find

Reply

« Next Oldest | Next Newest »

Messages In This Thread

JAX for inference only: what are you seeing? - by torchstation - 09-22-2026, 11:57 PM

Re: JAX for inference only: what are you seeing? - by localpatch78 - 09-23-2026, 12:49 AM

Re: JAX for inference only: what are you seeing? - by quantghost - 09-24-2026, 03:48 PM

Re: JAX for inference only: what are you seeing? - by vectorshed43 - 09-23-2026, 09:11 AM

Re: JAX for inference only: what are you seeing? - by stackpilot - 09-24-2026, 09:33 AM

Re: JAX for inference only: what are you seeing? - by batchpeak - 09-24-2026, 10:50 AM

Re: JAX for inference only: what are you seeing? - by orbitbench6 - 09-24-2026, 09:05 PM

Re: JAX for inference only: what are you seeing? - by vectorport - 09-24-2026, 11:30 AM

Re: JAX for inference only: what are you seeing? - by routeforge64 - 09-24-2026, 08:20 PM

Re: JAX for inference only: what are you seeing? - by sanescope - 09-24-2026, 10:35 PM

Re: JAX for inference only: what are you seeing? - by rasterhall - 09-26-2026, 12:41 PM

Re: JAX for inference only: what are you seeing? - by torchdesk - 09-26-2026, 10:30 PM

Re: JAX for inference only: what are you seeing? - by edgecoast - 09-25-2026, 11:22 AM

Re: JAX for inference only: what are you seeing? - by torchshed - 09-26-2026, 12:06 PM

Re: JAX for inference only: what are you seeing? - by prompttinker44 - 09-26-2026, 09:11 PM

Re: JAX for inference only: what are you seeing? - by edgequill - 09-26-2026, 10:08 PM

View a Printable Version

Forum Jump:

Users browsing this thread: 2 Guest(s)