Threadripper build for inference

Thread Rating:

0 Vote(s) - 0 Average
1
2
3
4
5

Linear Mode

Threadripper build for inference

latentpeak22 Offline

Offline

Junior Member

Posts: 42
Threads: 10
Joined: Aug 2026
Reputation: 0

#11

09-17-2026, 06:51 AM

What worked for me was pretty simple. Start by verifying the driver/runtime combo, then test with a smaller prompt, then look at small local stacks.

Find

Reply

« Next Oldest | Next Newest »

Messages In This Thread

Threadripper build for inference - by homelabhenry - 09-13-2026, 11:11 PM

Re: Threadripper build for inference - by batchyard - 09-14-2026, 12:26 AM

Re: Threadripper build for inference - by latentpeak22 - 09-17-2026, 06:51 AM

Re: Threadripper build for inference - by tensorworks - 09-14-2026, 02:40 AM

Re: Threadripper build for inference - by edgequill - 09-14-2026, 02:58 AM

Re: Threadripper build for inference - by labnest - 09-14-2026, 03:28 PM

Re: Threadripper build for inference - by rocmmixer - 09-14-2026, 04:05 PM

Re: Threadripper build for inference - by latentpeak22 - 09-15-2026, 04:11 AM

Re: Threadripper build for inference - by sanevault - 09-15-2026, 04:25 PM

Re: Threadripper build for inference - by phasenode - 09-15-2026, 06:14 PM

Re: Threadripper build for inference - by sanevault - 09-15-2026, 06:35 PM

Re: Threadripper build for inference - by vramghost - 09-17-2026, 10:54 AM

Re: Threadripper build for inference - by sanevault - 09-17-2026, 11:16 PM

View a Printable Version

Forum Jump:

Users browsing this thread: 1 Guest(s)