+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Drivers / Frameworks / Toolkits (https://www.datasculpting.ai/inference/forumdisplay.php?fid=8)
+--- Forum: NVIDIA / CUDA (https://www.datasculpting.ai/inference/forumdisplay.php?fid=31)
+--- Thread: Tensor cores actually helping here on dual 3090 (/showthread.php?tid=582)
Pages:
1
2
Re: Tensor cores actually helping here on dual 3090 - audioriver - 10-10-2026
Did a small comparison this afternoon. I couldn't reproduce the slowdown until I pushed context much higher. I expected the model choice to matter more than it did.
Re: Tensor cores actually helping here on dual 3090 - tinycontext - 10-10-2026
Quote:Did a small comparison this afternoon. I couldn't reproduce the slowdown until I pushed context much higher. I expected the model choice to matter mor
Ran a quick check on my box. On A6000 with PyTorch, I saw basically the same behavior. The main thing that moved was latency, not quality.