10-11-2026, 03:06 PM
Wanted to compare notes with people doing similar things.
I'm mostly working with Mistral in MLX on mini PC. The part I'm trying to understand is tokens/sec.
Not looking for the perfect answer, mostly what worked in real use.
I care more about stability than squeezing the last possible tokens/sec out of it.
I'm mostly working with Mistral in MLX on mini PC. The part I'm trying to understand is tokens/sec.
Not looking for the perfect answer, mostly what worked in real use.
I care more about stability than squeezing the last possible tokens/sec out of it.