+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Evaluation & Testing (https://www.datasculpting.ai/inference/forumdisplay.php?fid=16)
+--- Forum: Benchmarks (https://www.datasculpting.ai/inference/forumdisplay.php?fid=65)
+--- Thread: comparing models without fooling yourself on GB200 (/showthread.php?tid=1470)
Pages:
1
2
Re: comparing models without fooling yourself on GB200 - kernelarch - 10-19-2026
A couple things I'd check first. Before rebuilding anything, I'd test one clean baseline with Gemma and compare from there.
Re: comparing models without fooling yourself on GB200 - prompttinker44 - 10-19-2026
Appreciate the detail. That matches what I saw on GB200. The biggest change for me was simplifying the stack instead of adding one more optimization layer.
Re: comparing models without fooling yourself on GB200 - batchfield55 - 10-19-2026
A couple questions before I guess too hard. Are you testing this on M3 Max or something else?
I'm happy to test one more variant if you want a second data point.
Re: comparing models without fooling yourself on GB200 - northgrid33 - 10-19-2026
Maybe, but I had the opposite result. I wouldn't optimize around that first. On my side the bigger swing came from the runtime and not the model.