best local runtime for mixed models with TensorRT-LLM

[latentscope35]

Did a bit of testing and thought I'd post the result here.

Short version: PyTorch behaved well for me, but only after I stopped ignoring NVFP4.

Curious if anyone else landed in the same place.

[mellowwire98]

Interesting, I hadn't tried that. The pattern around small local stacks has been pretty similar for me.