simple router policy ideas

[tinycontext]

Posting this in case it saves someone else a little time.

I'm helping a small team set up a local workflow. We don't need a giant stack, but we do care about HBM constraints.

Simple and boring is a valid answer.

If I had to summarize the lesson so far, it would be that clean setup and observability beat clever guesses.

[cozygrid12]

Posting this in case it saves someone else a little time.

My first guess would be this: Before rebuilding anything, I'd test one clean baseline with Kimi and compare from there. Not glamorous advice, but repeatable baselines save a lot of time.

[dockridge]

I think the bottleneck is somewhere else. I wouldn't optimize around that first. On my side the bigger swing came from the runtime and not the model. I keep promising myself this is the last rebuild.