Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
JAX for inference only with LM Studio
#11
Quote:[quote]Did a small comparison this afternoon. On 5090 with LM Studio, I saw basically the same behavior. The surprise was that memory pressure showed

That matches what I was seeing. I ended up in about the same place using LM Studio. The biggest change for me was simplifying the stack instead of adding one more optimization layer.
Reply


Messages In This Thread
Re: JAX for inference only with LM Studio - by phasestream53 - 10-02-2026, 12:23 AM

Forum Jump:


Users browsing this thread: 1 Guest(s)