Inference › Drivers / Frameworks / Toolkits › PyTorch / JAX / Other Frameworks v
PyTorch compile got faster? with vLLM

Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Linear Mode
PyTorch compile got faster? with vLLM
cachelab Offline
Junior Member
**
Posts: 25
Threads: 4
Joined: Aug 2026
Reputation: 0
#3
09-08-2026, 02:35 PM
My first guess would be this: If you're on MLX, I'd confirm the version first and then reduce variables until the behavior is obvious.
small models can still be good
Find
Reply


Messages In This Thread
Re: PyTorch compile got faster? with vLLM - by cachelab - 09-08-2026, 02:35 PM

Forum Jump:


Users browsing this thread: 1 Guest(s)