frankenmerges anyone kept using with MLX

[rocmpath]

Posting this in case it saves someone else a little time.

If you were starting from scratch today for this use case, what would you choose first and what would you ignore?

Simple and boring is a valid answer.

[southtinker]

Posting this in case it saves someone else a little time.

Good point. I don't think your conclusion is far off. The biggest change for me was simplifying the stack instead of adding one more optimization layer.

[localtinker]

What worked for me was pretty simple. If you're on LM Studio, I'd confirm the version first and then reduce variables until the behavior is obvious. Not glamorous advice, but repeatable baselines save a lot of time.

[rasterbench]

that fixed it for me too. I keep promising myself this is the last rebuild.

[labline]

I'd approach it in a boring order. If you're on SGLang, I'd confirm the version first and then reduce variables until the behavior is obvious. Not glamorous advice, but repeatable baselines save a lot of time.

[deepseeked]

Did a small comparison this afternoon. My result was mixed: first run looked bad, second run looked normal.

[cozyarch]

subscribed, curious where this lands.