Inference
what music do you benchmark to for Mixtral - Printable Version

+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Miscellaneous Discussion (https://www.datasculpting.ai/inference/forumdisplay.php?fid=24)
+--- Forum: Off Topic (https://www.datasculpting.ai/inference/forumdisplay.php?fid=27)
+--- Thread: what music do you benchmark to for Mixtral (/showthread.php?tid=960)



what music do you benchmark to for Mixtral - thetatinker77 - 10-09-2026

Posting this in case it saves someone else a little time.

I'm not trying to build a perfect architecture diagram. I just want a sane starting point around LM Studio and M3 Max.

I'm especially interested in mistakes worth avoiding.


Re: what music do you benchmark to for Mixtral - audiorunner74 - 10-10-2026

Quote:Posting this in case it saves someone else a little time.

I think the bottleneck is somewhere else. The reported numbers can look compelling, but in ordinary usage I didn't see the same benefit. Worth testing the simpler explanation before adopting the more interesting one.


Re: what music do you benchmark to for Mixtral - deltapoint17 - 10-10-2026

I hit almost the same issue last night.


Re: what music do you benchmark to for Mixtral - kernelghost - 10-10-2026

same here on my side.


Re: what music do you benchmark to for Mixtral - amberpatch25 - 10-10-2026

I'd approach it in a boring order. Before rebuilding anything, I'd test one clean baseline with Qwen and compare from there. A lot of these threads end up being one bad config plus a pile of conclusions drawn from it.


Re: what music do you benchmark to for Mixtral - phasetrack - 10-11-2026

Good point. I ended up in about the same place using llama.cpp. The biggest change for me was simplifying the stack instead of adding one more optimization layer.