Threadripper build for inference

Thread Rating:

0 Vote(s) - 0 Average
1
2
3
4
5

Linear Mode

Threadripper build for inference

vrambandit Offline

Member

Posts: 168
Threads: 14
Joined: Sep 2026
Reputation: 0

10-06-2026, 05:42 AM

I tested this tonight. My result was mixed: first run looked bad, second run looked normal. The surprise was that memory pressure showed up before throughput collapsed.

2x3090 • llama.cpp • too much VRAM is still not enough

Find

« Next Oldest | Next Newest »

Messages In This Thread

Threadripper build for inference - by visionforge - 10-05-2026, 05:24 AM

Re: Threadripper build for inference - by batchwire - 10-05-2026, 05:38 AM

Re: Threadripper build for inference - by vrambandit - 10-06-2026, 05:42 AM

Re: Threadripper build for inference - by stackpilot - 10-09-2026, 06:26 AM

Re: Threadripper build for inference - by homelabhenry - 10-09-2026, 10:52 AM

Re: Threadripper build for inference - by bytegarden73 - 10-09-2026, 11:28 AM

Re: Threadripper build for inference - by batchwire - 10-09-2026, 11:59 AM

Re: Threadripper build for inference - by plainscope50 - 10-09-2026, 01:02 PM

Re: Threadripper build for inference - by batchwire - 10-09-2026, 02:12 PM

Re: Threadripper build for inference - by cozygrid12 - 10-10-2026, 02:23 PM

Re: Threadripper build for inference - by sanevault - 10-10-2026, 10:58 PM

Re: Threadripper build for inference - by promptfield - 10-12-2026, 11:42 AM

Re: Threadripper build for inference - by edgequill - 10-12-2026, 11:57 AM

Re: Threadripper build for inference - by plainscope50 - 10-12-2026, 04:40 PM

View a Printable Version

Forum Jump:

Users browsing this thread: 1 Guest(s)

Login
Username:
Password:	Lost Password?
	Remember me

Sign in with X.com