10-12-2026, 05:12 AM
Wanted to compare notes with people doing similar things.
I'm mostly working with Mixtral in MLX on B200. The part I'm trying to understand is tokens/sec.
Would appreciate practical advice rather than theory.
I care more about stability than squeezing the last possible tokens/sec out of it.
I'm mostly working with Mixtral in MLX on B200. The part I'm trying to understand is tokens/sec.
Would appreciate practical advice rather than theory.
I care more about stability than squeezing the last possible tokens/sec out of it.