Threadripper build for inference on A6000

Thread Rating:

0 Vote(s) - 0 Average
1
2
3
4
5

Linear Mode

Threadripper build for inference on A6000

tinycontext Offline

Offline

Member

Posts: 112
Threads: 12
Joined: Sep 2026
Reputation: 0

#4

10-02-2026, 07:12 PM

I tested this tonight. My result was mixed: first run looked bad, second run looked normal. I expected the model choice to matter more than it did.

context windows are not a product strategy

Find

Reply

« Next Oldest | Next Newest »

Messages In This Thread

Threadripper build for inference on A6000 - by vectorember - 10-02-2026, 12:24 PM

Re: Threadripper build for inference on A6000 - by labnest - 10-02-2026, 04:44 PM

Re: Threadripper build for inference on A6000 - by tensorworks - 10-05-2026, 10:47 AM

Re: Threadripper build for inference on A6000 - by stackarch - 10-02-2026, 06:00 PM

Re: Threadripper build for inference on A6000 - by tinycontext - 10-02-2026, 07:12 PM

Re: Threadripper build for inference on A6000 - by latentpeak22 - 10-04-2026, 10:32 PM

Re: Threadripper build for inference on A6000 - by Data Sculpting - 10-02-2026, 09:27 PM

Re: Threadripper build for inference on A6000 - by kernelghost - 10-05-2026, 03:58 PM

Re: Threadripper build for inference on A6000 - by sanevault - 10-04-2026, 09:47 AM

Re: Threadripper build for inference on A6000 - by edgequill - 10-08-2026, 05:00 PM

Re: Threadripper build for inference on A6000 - by homelabhenry - 10-05-2026, 03:27 PM

Re: Threadripper build for inference on A6000 - by sanevault - 10-07-2026, 04:44 AM

Re: Threadripper build for inference on A6000 - by vectorcrate98 - 10-11-2026, 05:25 PM

Re: Threadripper build for inference on A6000 - by edgequill - 10-13-2026, 05:38 AM

Re: Threadripper build for inference on A6000 - by phasenode - 10-13-2026, 06:29 AM

View a Printable Version

Forum Jump:

Users browsing this thread: 1 Guest(s)