![]() |
|
JAX for inference only with LM Studio - Printable Version +- Inference (https://www.datasculpting.ai/inference) +-- Forum: Drivers / Frameworks / Toolkits (https://www.datasculpting.ai/inference/forumdisplay.php?fid=8) +--- Forum: PyTorch / JAX / Other Frameworks (https://www.datasculpting.ai/inference/forumdisplay.php?fid=34) +--- Thread: JAX for inference only with LM Studio (/showthread.php?tid=349) Pages:
1
2
|
Re: JAX for inference only with LM Studio - phasestream53 - 10-02-2026 Quote:[quote]Did a small comparison this afternoon. On 5090 with LM Studio, I saw basically the same behavior. The surprise was that memory pressure showed That matches what I was seeing. I ended up in about the same place using LM Studio. The biggest change for me was simplifying the stack instead of adding one more optimization layer. |