Inference › Drivers / Frameworks / Toolkits › NVIDIA / CUDA v
Tensor cores actually helping here for Gemma

Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Linear Mode
Tensor cores actually helping here for Gemma
marbletrack Offline
Member
***
Posts: 61
Threads: 6
Joined: Sep 2026
Reputation: 0
#8
10-14-2026, 08:51 AM
Interesting, I hadn't tried that. That matches what I saw on A6000. I got better results once I stopped chasing one metric and just looked at whether the workflow felt usable.

If you post your exact settings, people here can probably narrow it down pretty fast.
Find
Reply


Messages In This Thread
Re: Tensor cores actually helping here for Gemma - by marbletrack - 10-14-2026, 08:51 AM

Forum Jump:


Users browsing this thread: 1 Guest(s)