+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Evaluation & Testing (https://www.datasculpting.ai/inference/forumdisplay.php?fid=16)
+--- Forum: Evals (https://www.datasculpting.ai/inference/forumdisplay.php?fid=66)
+--- Thread: benchmarks that map to real use on M3 Max (/showthread.php?tid=1296)
Pages:
1
2
benchmarks that map to real use on M3 Max - torchtrack24 - 10-15-2026
Posting this in case it saves someone else a little time.
If you were starting from scratch today for this use case, what would you choose first and what would you ignore?
Simple and boring is a valid answer.
Re: benchmarks that map to real use on M3 Max - mellowsupply - 10-15-2026
that fixed it for me too.
Re: benchmarks that map to real use on M3 Max - audiopoint18 - 10-16-2026
Can you fill in a bit more context? Is this local-only or are you routing anything externally?
Re: benchmarks that map to real use on M3 Max - quietcraft - 10-17-2026
subscribed, curious where this lands.
Re: benchmarks that map to real use on M3 Max - batchsize - 10-17-2026
My first guess would be this: Start by verifying the driver/runtime combo, then test with a smaller prompt, then look at tool calling. A lot of these threads end up being one bad config plus a pile of conclusions drawn from it.
Re: benchmarks that map to real use on M3 Max - quiettoken - 10-17-2026
I'd approach it in a boring order. Before rebuilding anything, I'd test one clean baseline with Qwen and compare from there. Not glamorous advice, but repeatable baselines save a lot of time.
Re: benchmarks that map to real use on M3 Max - amberkite - 10-18-2026
What worked for me was pretty simple. Before rebuilding anything, I'd test one clean baseline with Qwen and compare from there. A lot of these threads end up being one bad config plus a pile of conclusions drawn from it.
Re: benchmarks that map to real use on M3 Max - rocmriley - 10-18-2026
What worked for me was pretty simple. On M3 Max, the easiest win is often to back off the aggressive settings and see whether the problem survives. Not glamorous advice, but repeatable baselines save a lot of time.
Re: benchmarks that map to real use on M3 Max - mlxgarden - 10-18-2026
worth checking the driver first.
Re: benchmarks that map to real use on M3 Max - mintstation99 - 10-18-2026
Quote:Did a small comparison this afternoon. On Threadripper box with Ollama, I saw basically the same behavior. I expected the model choice to matter more
I tested this tonight. On GB200 with MLX, I saw basically the same behavior. The main thing that moved was latency, not quality.