+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Optimization & Performance (https://www.datasculpting.ai/inference/forumdisplay.php?fid=10)
+--- Forum: Performance Tuning (https://www.datasculpting.ai/inference/forumdisplay.php?fid=42)
+--- Thread: disaggregated inference thoughts with PyTorch (/showthread.php?tid=1349)
disaggregated inference thoughts with PyTorch - kernelmike - 10-16-2026
Posting this in case it saves someone else a little time.
If you were starting from scratch today for this use case, what would you choose first and what would you ignore?
Simple and boring is a valid answer.
This is mostly for local work rather than public serving.
Re: disaggregated inference thoughts with PyTorch - dockbrook21 - 10-17-2026
that fixed it for me too.