+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Drivers / Frameworks / Toolkits (https://www.datasculpting.ai/inference/forumdisplay.php?fid=8)
+--- Forum: PyTorch / JAX / Other Frameworks (https://www.datasculpting.ai/inference/forumdisplay.php?fid=34)
+--- Thread: PyTorch compile got faster? (/showthread.php?tid=1443)
PyTorch compile got faster? - dockridge - 10-18-2026
Spent some time on this today and wanted to compare notes.
I've gone back and forth between SGLang and llama.cpp for Llama. The interesting difference for me has been speculative decoding.
What would you pick if you had to live with it for a few months?
Re: PyTorch compile got faster? - deepseeked - 10-19-2026
worth checking the driver first.