09-29-2026, 10:10 PM
Spent some time on this today and wanted to compare notes.
I've gone back and forth between SGLang and SGLang for Kimi. The interesting difference for me has been HBM constraints.
What would you pick if you had to live with it for a few months?
For context, I'm not chasing leaderboard numbers. I mostly want the system to feel consistent day to day.
I've gone back and forth between SGLang and SGLang for Kimi. The interesting difference for me has been HBM constraints.
What would you pick if you had to live with it for a few months?
For context, I'm not chasing leaderboard numbers. I mostly want the system to feel consistent day to day.
routing beats arguing over one perfect model