simple router policy ideas: anyone testing this?

[turboscope5]

Did a bit of testing and thought I'd post the result here.

Short version: TensorRT-LLM behaved well for me, but only after I stopped ignoring tail latency.

Curious if anyone else landed in the same place.