+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Drivers / Frameworks / Toolkits (https://www.datasculpting.ai/inference/forumdisplay.php?fid=8)
+--- Forum: PyTorch / JAX / Other Frameworks (https://www.datasculpting.ai/inference/forumdisplay.php?fid=34)
+--- Thread: framework overhead in real deployments: anyone testing this? (/showthread.php?tid=1440)
Pages:
1
2
Re: framework overhead in real deployments: anyone testing this? - mlxgarden - 10-19-2026
My first guess would be this: On 5090, the easiest win is often to back off the aggressive settings and see whether the problem survives.
Re: framework overhead in real deployments: anyone testing this? - relaynest82 - 10-19-2026
Appreciate the detail. I ended up in about the same place using PyTorch. Worth rechecking your defaults though, because one bad assumption can make the rest of the thread look confusing.