![]() |
|
what music do you benchmark to for Mixtral - Printable Version +- Inference (https://www.datasculpting.ai/inference) +-- Forum: Miscellaneous Discussion (https://www.datasculpting.ai/inference/forumdisplay.php?fid=24) +--- Forum: Off Topic (https://www.datasculpting.ai/inference/forumdisplay.php?fid=27) +--- Thread: what music do you benchmark to for Mixtral (/showthread.php?tid=960) |
what music do you benchmark to for Mixtral - thetatinker77 - 10-09-2026 Posting this in case it saves someone else a little time. I'm not trying to build a perfect architecture diagram. I just want a sane starting point around LM Studio and M3 Max. I'm especially interested in mistakes worth avoiding. Re: what music do you benchmark to for Mixtral - audiorunner74 - 10-10-2026 Quote:Posting this in case it saves someone else a little time. I think the bottleneck is somewhere else. The reported numbers can look compelling, but in ordinary usage I didn't see the same benefit. Worth testing the simpler explanation before adopting the more interesting one. Re: what music do you benchmark to for Mixtral - deltapoint17 - 10-10-2026 I hit almost the same issue last night. Re: what music do you benchmark to for Mixtral - kernelghost - 10-10-2026 same here on my side. Re: what music do you benchmark to for Mixtral - amberpatch25 - 10-10-2026 I'd approach it in a boring order. Before rebuilding anything, I'd test one clean baseline with Qwen and compare from there. A lot of these threads end up being one bad config plus a pile of conclusions drawn from it. Re: what music do you benchmark to for Mixtral - phasetrack - 10-11-2026 Good point. I ended up in about the same place using llama.cpp. The biggest change for me was simplifying the stack instead of adding one more optimization layer. |