best mini PC for local use for Kimi

[byteyard]

My first guess would be this: On mini PC, the easiest win is often to back off the aggressive settings and see whether the problem survives.

[tensorfield88]

Need a little more detail here. Is this local-only or are you routing anything externally?

[homelabhenry]

What worked for me was pretty simple. On A6000, the easiest win is often to back off the aggressive settings and see whether the problem survives. Not glamorous advice, but repeatable baselines save a lot of time.

[quantsupply]

following this because I'm in the same boat.

Need a little more detail here. Is this local-only or are you routing anything externally?

[homelabhenry]

A couple things I'd check first. Start by verifying the driver/runtime combo, then test with a smaller prompt, then look at prefill/decode split. Not glamorous advice, but repeatable baselines save a lot of time.