Threadripper build for inference

Thread Rating:

0 Vote(s) - 0 Average
1
2
3
4
5

Linear Mode

Threadripper build for inference

sanevault Offline

Offline

Member

Posts: 53
Threads: 5
Joined: Sep 2026
Reputation: 0

#10

09-15-2026, 06:35 PM

Tried to reproduce it just now. On B200 with MLX, I saw basically the same behavior. The main thing that moved was latency, not quality.

small models can still be good

Find

Reply

« Next Oldest | Next Newest »

Messages In This Thread

Threadripper build for inference - by homelabhenry - 09-13-2026, 11:11 PM

Re: Threadripper build for inference - by batchyard - 09-14-2026, 12:26 AM

Re: Threadripper build for inference - by latentpeak22 - 09-17-2026, 06:51 AM

Re: Threadripper build for inference - by tensorworks - 09-14-2026, 02:40 AM

Re: Threadripper build for inference - by edgequill - 09-14-2026, 02:58 AM

Re: Threadripper build for inference - by labnest - 09-14-2026, 03:28 PM

Re: Threadripper build for inference - by rocmmixer - 09-14-2026, 04:05 PM

Re: Threadripper build for inference - by latentpeak22 - 09-15-2026, 04:11 AM

Re: Threadripper build for inference - by sanevault - 09-15-2026, 04:25 PM

Re: Threadripper build for inference - by phasenode - 09-15-2026, 06:14 PM

Re: Threadripper build for inference - by sanevault - 09-15-2026, 06:35 PM

Re: Threadripper build for inference - by vramghost - 09-17-2026, 10:54 AM

Re: Threadripper build for inference - by sanevault - 09-17-2026, 11:16 PM

View a Printable Version

Forum Jump:

Users browsing this thread: 1 Guest(s)