Threadripper build for inference on A6000

Thread Rating:

0 Vote(s) - 0 Average
1
2
3
4
5

Linear Mode

Threadripper build for inference on A6000

vectorcrate98 Offline

Offline

Junior Member

Posts: 41
Threads: 4
Joined: Sep 2026
Reputation: 0

#13

10-11-2026, 05:25 PM

Not sure I agree there. I wouldn't optimize around that first. On my side the bigger swing came from the runtime and not the model.

Find

Reply

« Next Oldest | Next Newest »

Messages In This Thread

Threadripper build for inference on A6000 - by vectorember - 10-02-2026, 12:24 PM

Re: Threadripper build for inference on A6000 - by labnest - 10-02-2026, 04:44 PM

Re: Threadripper build for inference on A6000 - by tensorworks - 10-05-2026, 10:47 AM

Re: Threadripper build for inference on A6000 - by stackarch - 10-02-2026, 06:00 PM

Re: Threadripper build for inference on A6000 - by tinycontext - 10-02-2026, 07:12 PM

Re: Threadripper build for inference on A6000 - by latentpeak22 - 10-04-2026, 10:32 PM

Re: Threadripper build for inference on A6000 - by Data Sculpting - 10-02-2026, 09:27 PM

Re: Threadripper build for inference on A6000 - by kernelghost - 10-05-2026, 03:58 PM

Re: Threadripper build for inference on A6000 - by sanevault - 10-04-2026, 09:47 AM

Re: Threadripper build for inference on A6000 - by edgequill - 10-08-2026, 05:00 PM

Re: Threadripper build for inference on A6000 - by homelabhenry - 10-05-2026, 03:27 PM

Re: Threadripper build for inference on A6000 - by sanevault - 10-07-2026, 04:44 AM

Re: Threadripper build for inference on A6000 - by vectorcrate98 - 10-11-2026, 05:25 PM

Re: Threadripper build for inference on A6000 - by edgequill - 10-13-2026, 05:38 AM

Re: Threadripper build for inference on A6000 - by phasenode - 10-13-2026, 06:29 AM

View a Printable Version

Forum Jump:

Users browsing this thread: 1 Guest(s)