Inference
Tensor cores actually helping here - Printable Version

+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Drivers / Frameworks / Toolkits (https://www.datasculpting.ai/inference/forumdisplay.php?fid=8)
+--- Forum: NVIDIA / CUDA (https://www.datasculpting.ai/inference/forumdisplay.php?fid=31)
+--- Thread: Tensor cores actually helping here (/showthread.php?tid=931)



Tensor cores actually helping here - mintforge - 10-08-2026

Spent some time on this today and wanted to compare notes.

Two paths both seem viable, but they break down differently once HBM constraints becomes important.

What would you pick if you had to live with it for a few months?


Re: Tensor cores actually helping here - audiopath66 - 10-10-2026

Quote:Spent some time on this today and wanted to compare notes.

Interesting, I hadn't tried that. That matches what I saw on M3 Max. I got better results once I stopped chasing one metric and just looked at whether the workflow felt usable.