simple router policy ideas: what are you seeing?

[fastquill74]

I think the bottleneck is somewhere else. I've seen people blame MoE serving when the real issue was much more mundane. Worth testing the simpler explanation before adopting the more interesting one.

There are a few different conversations hiding inside this thread, so being explicit about the goal helps.